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PREFACE 
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Most statistics textbooks concentrate on theoretical discussions and mathematical 
proofs of the various concepts presented. The result of this approach is that students 
often have little understanding of how actually to apply statistical tests to their 
experimental findings. The intent of this book is to reverse this approach and to 
present statistical concepts and tests as they are applied. 


Our experience has indicated that carefully worked and clearly described examples 
can be easily generalized to a wide variety of situations. Consequently, the method of 
presentation employed throughout this book is based primarily on the technique of 
teaching by example. The mathematical proofs and theoretical discussions that 
appear in most textbooks are, for the most part, excluded. What has been substi- 
tuted is a step-by-step analysis of the computational procedures needed to test the 
significance of experimental findings. Each test or analysis is illustrated by a clearly 
worked example, and all computational steps and procedures are expressed verbally 
rather than in mathematical symbols. Thus, while the analyses range from the 
simplest f-test or correlation to the most complex analysis of variance or multiple 
correlation, almost no previous mathematical knowledge is required to use this book 
effectively. 


Although the amount of theoretical discussion presented in this book is minimal, 
the assumptions and basic computational formulas for the various analyses are 
presented either at the beginning of each section or are incorporated into the example 
used to demonstrate the computations. These are included, in all but one part of 
the book, to aid the user in determining the relationship between theory and compu- 
tational procedure and also the relevance of each analysis to his particular problem. 
In each of the sections in Part 2, on analysis of variance, formulas are replaced for 
the most part by a selective bibliography of current statistics texts. The reasons for 
this are twofold. First, the symbolic notation for these analyses varies widely; and 
second, the presentation of this material in terms of formulas and symbols would 
have consumed more time and space than was deemed appropriate in a text of this 


type. 


Although most of the examples in the book deal with the analysis of experimental 
findings in the fields of the behavioral and social sciences, this text is equally ap- 
propriate for courses in education, business, medical research, or any other area 
where statistical analysis of data is required. In addition, because of its broad range 
of coverage, it is also appropriate for courses at both the undergraduate and gradu- 
ate levels. 


Since this book requires little matherhatical or formal statistical background, it 
should prove invaluable to instructors in beginning laboratory courses where stu- 


dents typically have completed only the most basic statistics course. Use of this 
book will permit the design and analysis of more advanced experiments where 
additional variables are manipulated or repeated measures taken. Our experience 
has been that the student need only be told which analysis he should apply to his 
data. From that point, nearly all individuals can follow the step-by-step presenta- 
tion to completion of the entire analysis. 


It has also been our experience that the same use can be made of this text by assist- 
ants with limited statistical backgrounds, who are assigned to carry out the analysis 
of an experiment. With the aid of this handbook, even the most inexperienced 
assistant can compute highly complex analyses with little or no additional super- 
vision. 


One other important use of this book has been noted by individuals interested in 
computer programing. Since the computational steps of each analysis are indi- 
cated separately, they represent a detailed flow chart of the instructions that must 
be included in a computer program. To illustrate this application, two sample pro- 
grams, written from the computational steps presented in Sections 2.9 and 2.10, are 
presented in Appendix M. These programs represent the most complex problems 
that might be encountered in the programing of analyses of variance. In both 
instances, the basic approach was simply to translate the verbal steps outlined in 
this book into the FORTRAN language system. 


It would be impossible to thank everyone who has made either a direct or indirect 
contribution to this book. There are, however, several individuals whose influence 
warrants special recognition. First, we would like to express our appreciation to 
Dr. Dee W. Norton, whose methods of teaching “Design and Analysis of Experi- 
ments” led to our interest in this area. Dr. G. S. Reynolds and Dr. Louis Aikman 
read and critically evaluated the manuscript. Their comments were most helpful 
in making needed changes and improvements. Our publisher-author relationship 
has been all that could be desired, and we would like to extend thanks to Mr. Bruce 
Harlow, Mrs. Maud Benjamin, Mrs. Marguerite Clark, and Mr. John J. Miller, 
all of Scott, Foresman, for their interest, help, and encouragement. 


We are indebted to the Literary Executor of the late Sir Ronald A. Fisher, F.R.S., 
to Dr. Frank Yates, F.R.S., and to Oliver & Boyd Ltd., Edinburgh, for permission 
to reprint Tables III, V, and VI from their book Statistical Tables for Biological, 
Agricultural and Medical Research. 


Special thanks are extended to Messrs. Morris Morgret and Ronald Mihalick, for 
their permission to include the sample programs found in Appendix M. Also, our 
thanks to Dr. Paul Becker, who suggested the inclusion of these programs and whose 
suggestions for improvement of the manuscript were greatly appreciated. And to our 
wives, Marlene and Maria, a special statement of appreciation, not only for typing 
and editorial help but also for general encouragement in every phase of the manu- 
script development. 
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TO THE USER 
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As explained in the Preface, this book approaches statistics from the applied, 
rather than the theoretical, point of view. It is our hope that the extensive use of 
examples and the step-by-step presentation of the computational procedures will 
not only provide models to be followed in computing analyses but will also help 
the user to gain true insights into how each segment or step fits into the final analy- 
sis. It is also our hope that by presenting nearly all the material in verbal rather 
than symbolic form, this book will help dispel the fears that many have of statistics. 
At the same time, we have included as aids to the user the basic assumptions and 
computational formulas for each analysis. These are either presented at the begin- 
ning of each section or are incorporated into the computational example, except in 
Part 2. In each of the sections in this part, on analysis of variance, a selective 
bibliography of current statistical texts is presented instead. 


The following example demonstrates the methods of approach and presentation that 
are used throughout this book. 


EXAMPLE 


Assume that a physical education teacher has measured the heights of five boys 
in one of his classes. He now wishes to compute the average, or mean, height of this 
group. 

The mathematical formula for computation of the mean is 


where X = mean of the scores 
X = sum of the scores 
N = number of scores 


Step 1. First, table the scores as follows. No particular order is necessary. 


Subject Height 
(inches) 

Si 60 

So 53 

Ss 57 

Ss 52 


Ss : 58 


Step 2. Add all the scores to get the sum for the group. 
60 + 53 + 57 + 52 + 58 = 280 


Step 3. Computation of the mean: Divide the value of Step 2 by the number of 
scores (heights) which were added. (In the present example, there were 5 scores. ) 


a 280 
x = 5) = 56 inches 


While it is sometimes possible to use short cuts and combine steps (as in the above 
example), we recommend that to avoid error and to more fully understand the 
meaning of each step, the user closely follow the steps we have outlined. During 
initial study or computation, we also recommend that the user label each step since 
this greatly facilitates the correction of errors and review of points that were not 
clear. 
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PART 1 


Organizing Data and Some Simple Computations 


Research involves the making of systematic observations, organizing 
these observations in some meaningful fashion, and then, usually on the 
basis of statistical tests, drawing conclusions. Raw data—observations in 
their original form—are usually a mass of numbers or symbols that have 
little or no meaning. To allow even the most gross kinds of interpretations, 
the data must be organized in some fashion. Probably the simplest organi- 
zation is the classification of data into categories. In this instance, a count 
is usually made of the observations that fall into one class as opposed to 
another. A good example is an observation of a crowd that is later classified 
according to the number of males versus females present. Statistical pro- 
cedures to aid in the interpretation of data collected and organized in this 
fashion are usually (but not always) of the nonparametric type. These 
statistical tests are discussed in the last part of this book. 

The form of data organization that is of interest in the first four parts 
of this book involves the use of measures that are recorded for each of 
several observations. These measures almost always imply some notion of 
varying magnitude or amount. This type of classification differs from the 
first in that it implies varying amounts of an observation rather than 
simply indicating whether or not a particular observation was made. In the 
following sections, organization and computation of measures will be con- 
sidered in relation to various simple statistical tests that experimenters 
use as aids in drawing conclusions regarding the outcome of their research. 


2 / Part1 Organizing Data and Some Simple Computations 
Organizing Data (Sections 1.1, 1.2, and 1.3) 


These first three sections discuss some of the basic procedures for 
organizing data and putting it in an understandable form. While it is 
recognized that there are many other procedures for organizing data (such 
as frequency distributions, etc.), the ones presented in these chapters are 
those used most often. 


Some Simple Computations (Sections 1.4, 1.5, and 1.6) 


These three sections are concerned primarily with demonstrating the 
basic uses of the t-test. These include the ¢ for testing the difference between 
a sample and a population mean, the difference between two sample means, 
and the ¢ for related measures. 


SECTION 1.1 
Blocking and Tabling of Data 


In most experiments involving the collection and analysis of data, 
the data are grouped, or blocked, to reduce variability and to make the 
scores more manageable for statistical analysis. The most commonly used 
methods are to take the mean, median, or mode of several scores. The value 
obtained is then treated as a single score. 

For example, if the number of correct responses on each of fifteen 


trials was the measure recorded, the raw data for Subject 1 might appear 
as follows: 


Trial 2 oe OG or OF MO menial omelet a em S 
Correct responses for S; I ASi2006RT BSI5ih9. eNO 4a FOIA Oe: 


Since there are fifteen trials, the most reasonable grouping would probably 
be to combine each consecutive set of three or five trials. If only one score 


1.1 Blocking and Tabling of Data / 3 


were desired, the entire fifteen trials would be combined. The size of the 
group, or block, of data is entirely arbitrary. 

The most common technique is to take the mean of each successive 
set of trials. In the above example, assume that the experimenter decides 
to block by taking the mean of each successive five scores. Thus, the 
fifteen scores of S, would be reduced to three scores, as follows: 


Trial Block ] 2 3 
Mean of 5 trials for S; 2.8 6.6 10.2 


If an overall mean were desired, the experimenter would simply add 
all the correct responses and divide by the number of trials given. For 
S, this would be 98/15, which equals 6.53. 

Less frequently, the median or mode is used to block raw data. Use 
of these measures usually occurs only if the data within each set of scores 
are severely skewed. In the present example, the median would equal the 
middle score of each block of trials after the scores within each block had 
been rank ordered. Using the data presented above, the median of trials 
one through five would be 2, since there are two scores smaller than 2 (1, 1) 
and two larger (4, 6). The same type of computation would be made for 
trials six through ten and eleven through fifteen. 


Trial Block | 1 2 3 


Median of 5 trials for S; 


The overall median in this example would be 6. 
The mode is simply the score that occurs most often. When applied 
to blocks of five trials, the scores for S; become: 


Trial Block | 1 2 3 
Mode of 5 trials for S; 1 9 14 


The overall mode would be 9, since that score occurs three times 
during the fifteen trials. 

After the data have been blocked, they must be tabled so that sta- 
tistical analyses can be undertaken. While the specific method of tabling 
depends upon the statistical analyses to be used, the most common tech- 
nique involves simply identifying each subject and then entering his score 
or scores in a row to the right. For example, using the mean scores in the 
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above example: 


Trial Block 


Subject 1 2 3 
Si 2.8 6.6 10.2 
os 1.4 1.8 4.3 
Ss 2.1 6.7 6.4 


While it is apparent that different methods of blocking scores can result 
in different measures being recorded for each subject, the major point to 
note is that whenever raw data are blocked in some fashion, the statistical 
analyses may be based entirely on the blocked scores. In the above example, 
all analyses may be computed as though only three trials had been given 
or, if an overall score were used, as if only one score had been recorded. 
It is also important to note that for purposes of determining degrees of 
freedom (df), numbers of scores in a table, group means, etc., all compu- 
tations and numerical counts are based on the blocked scores and not on 
the raw data. 


SECTION 1.2 
Range and Standard Deviation 


By grouping and arranging scores, it is possible to get a fairly good 
understanding of the data that have been collected. In addition to grouping, 
however, it is usually desirable to obtain some idea of the dispersion of the 
scores. The simplest such measure is the range. This value is computed very 
simply since it is equal to the difference between the largest and smallest 
scores in the distribution. For example, in the sample data presented below, 
the tallest child is 72 inches and the shortest is 43 inches; the range, then, 
is 29 inches. 

Although the range does give some information regarding the dis- 
persion of the scores, its usefulness is limited. By far the most common 
and useful measure of dispersion is the standard deviation (s.d.). There are 
two ways to compute the standard deviation: directly, using difference 
scores; and indirectly, using the computational formula. As is shown in 
nearly all introductory textbooks, these two methods are actually the same. 


1.2 Range and Standard Deviation / 5 


Since the method that employs the computational formula is more generally 
applicable, it will be presented here. 


EXAMPLE 


This example is drawn from the area of developmental psychology. 
Assume that an experimenter is interested in obtaining information about 
the heights of twelve-year-olds. To do this, he collects a sample of data 
(the heights of twenty randomly selected twelve-year-olds) and proceeds 
to compute the standard deviation. 

The mathematical formula for the standard deviation is 


‘ 4/2 — OXF 
: N— 7 


where )_X? = the sum of the squared score values 
(>>X)? = the square of the sum of all the scores 
N = the total number of scores used in the computation 


Step 1. Table the data as follows. No particular order is necessary. 


Height 
Subject (inches) 
St 64 
So 48 
Ss 55 
S4 68 
Ss 12 
Se 59 
Sz 57 
Ss 61 
So 63 
Sto 60 
Su 60 
Si 43 
Sis 67 
Sis 70 
Sis 65 
Sis 55 
S17 56 
Sis 64 
S19 61 
Soo 60 


Step 2. Add all the scores. (Note: If you are using a calculator, you 
can do Step 2 and Step 3 at the same time.) 


64 + 48 + --- + 60 = 1208 
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Step 3. Square all the scores and add the squared values. 
642 + 48? + --+ + 60? = 73,894 


Siep 4. Square the sum obtained in Step 2, and divide this value 
by the number of scores that were added to obtain the sum. The resultant 
value is called the correction term. 


1208? 1,459,264 
, \ ee :. ( 


= 72,963 


Step 5. Subtract the value obtained in Step 4 from the sum in Step 3. 
73,894 — 72,963 = 931 


Step 6. Divide the value obtained in Step 5 by N — 1. (In this 
example, it would be 20 — 1 = 19.) The resultant value is called the 
variance. 


Step 7. Take the square root of the value obtained in Step 6.. This 
value is the standard deviation. 


SECTION 1.3 
Standard Error of the Mean 


The standard error of the mean is extremely simple to compute once 
the steps outlined in Section 1.2 have been completed. All that must be 
done is to follow Steps 1 through 7 of Section 1.2 and then divide the value 
obtained in Step 7 by the square root of the size of the sample. 

In the example used in Section 1.2, the value obtained in Step 7 was 
7 inches. Since there were 20 subjects in the sample, simply divide 7 by 
the square root of 20 to obtain the standard error of the mean. 


u ul 1.57 
2) ay 


1 This term is almost universally used since the division by N — 1 gives the unbiased estimate of the 
population variance rather than the actual variance of the sample. If the actual sample variance is desired, 
divide by N rather than N — 1. Step 7 is the same, regardless. 
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SECTION 1.4 


The t-Test for a Difference Between a Sample Mean 


and the Population Mean 


One of the most commonly used tests of significance is the t-test. 
One use of this test assumes that the mean for some population is known. 
Knowing this population — value, the experimenter can then determine 
whether the sample he has chosen is significantly different from the popu- 
lation mean. 


EXAMPLE 


This example uses the data presented in Section 1.2. Assume that 
after collecting measures of the heights of twenty randomly selected 
twelve-year-olds, the experimenter notices that while the standard devi- 
ation is large, the average height of the children in this sample is above 
the population average for twelve-year-olds. By use of the ¢-test, he can 
determine whether this difference is significant. 

The basic formula for testing the significance of a difference between 
a sample mean and population mean is 


f =e 
. (xe 
ee ty a 
Dx "7 
N(N — 1) 
where X = the mean of the sample 


yu = the mean of the population 
>> X? = the sum of the squared score values 
(>°X)? = the square of the sum of all the scores 
the number of scores used in the analysis 


Step 1. Table the data as follows. No particular order is necessary. 


Height 
Subject (inches) 
Sy 64 
Se 48 
Ss 55 
S4 68 
Ss i2 
Se 59 
Sy 57 
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Height’ 

Subject (inches) 
So 63 
Sio 60 
Su 60 
Si2 43 
Sis 67 
Siu 70 
Sis 65 
Si6 55 
Si 56 
Sig 64 
Sto 61 
S20 60 


Step 2. Add all the scores. (Note: If you are using a calculator, you 
can do Step 2 and Step 3 at the same time.) 


64 + 48 + +--+ + 60 = 1208 
Step 3. Square all the scores, and add these squared values. 
64? + 487+ --- + 60? = 73,894 


Step 4. Square the sum obtained in Step 2. Then divide this value 
by the number of scores that were added to get the sum. (In the present 
example, 20 scores were added.) The resultant value is called the correction 
term. 


1208? 1,459,264 
0.4 ee 


= 72,963 


Step 5. Subtract the result of Step 4 from the sum in Step 3. 
73,894 — 72,963 = 931 


Step 6. Divide the value obtained in Step 5 by N — 1. (In the 
present example, it would be 20 — 1 = 19.) 


Step 7. Take the square root of the value obtained in Step 6. 
/49 = Tin. 


Step 8. Divide the value of Step 7 by ~/N. (In the present example, 
0/20 = 4.47.) 


ve 
447 = 1bsy/ 
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Step 9. Subtract the sample mean (sum in Step 2 divided by WV) 
from the population mean (known from some other source). 
1208 


—— = 60.4 
20 Ms 


sample mean 


58.0 


population mean read from growth-curve tables 
58.0 — 60.4 = 2.4 


(Note: For computational purposes, only the absolute difference between 
the means is important.) 

Step 10. Divide the value obtained in Step 9 by the value obtained 
in Step 8. This yields the ¢ value. 


Step 11. To determine whether the ¢ value is significant, the degrees 
of freedom must be obtained. For a test of significance of a sample mean 
and a population mean, the df are equal to N — 1. In the present example, 
this would be 20 — 1 = 19. The ¢ for significance at the .05 level (see 
Appendix B) is 2.098. Since the ¢ value in the present example is smaller 
than 2.093, it is concluded that there is no significant difference between 
this sample mean and the population mean. 


SECTION 1.5 


The t-Test for a Difference Between Two Independent 


Means 


Probably the most common use of the ¢-test is to determine whether 
the performance difference between two groups of subjects is significant. 
In most experimental situations, the subjects are randomly assigned to the 
two groups; one of the groups is manipulated experimentally, and the 
effects of this manipulation are analyzed by comparing the performance of 
the two groups. However, there are many instances where the groups are 
already constituted (e.g., males versus females) and the experimenter 
wishes to determine whether they differ with respect to some other variable 
(e.g., height, weight, etc.). 
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EXAMPLE 


Assume that a principal wishes to determine whether there is a sig- 
nificant difference between the IQ scores of boys and girls in a particular 
grade. The score recorded for each student is his score on the Wechsler 
Intelligence Scale for Children (WISC). 

The basic computational formula for the t-test of a difference between 
two independent means is 7s : 


; X, — X 
a Rar (20 X2)? 
ae aot 1 i 
/ tS ee lee 
(Ni + Nz) — 2 coe 
where X, = the mean of the first group of scores 


X_ = the mean of the second group of scores 
>> X? = the sum of the squared score values of the first group 
>> X,? = the sum of the squared score values of the second group 
(>°X,)? = the square of the sum of the scores in the first group 
(>> X2)? = the square of the sum of the scores in the second group 
N, = the number of scores in the first group 
Nz = the number of scores in the second group 


Step 1. Table the data as follows. No particular order within groups 
is necessary. 


Group 1 (Boys) Group 2 (Girls) 
Subject Score Subject Score 
Si 107 Sis 109 
S2 96 Sis 94 
Ss 88 Sts 127 
Ss ke Si6 76 
Ss 109 Si 115 
S6 84 Sis 121 
S7 79 Si9 87 
Ss 105 S20 92 
So 108 Sa 91 
Sto 92 Soo 98 
Su 96 So3 104 
She 101 Soa 96 
Sos 110 

Soe 108 


Step 2. Add the scores in Group 1. (Note: If you are using a calcu- 
lator, Step 2 and Step 3 can be done at the same time.) 


107 + 96 + --- + 101 = 1196 
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Step 3. Square every score in Group 1, and add these squared values. 
107? + 96? + +++ + 101? = 121,318 


Step 4. Square the value obtained in Step 2. Then divide the squared 
value by the number of scores on which the sum was based. (In this 
example, 12 scores were added.) 


1196? 1,430,416 
13) } 12 


= 119,201 


Step 5. Subtract the value obtained in Step 4 from the sum in Step 3. 
121,318 — 119,201 = 2117 
Step 6. Add the scores in Group 2. 
109 + 94 + +++ + 108 = 1428 
Step 7. Square every score in Group 2, and add these squared values. 
109? + 942 + -++ + 108? = 148,202 


Step 8. Square the value obtained in Step 6. Then divide the squared 
value by the number of scores on which the sum was based. (In the present 
example, 14 scores were added.) 


1428? 2,039,184 
\ itt 14 


= 145,656 


Step 9. Subtract the value obtained in Step 8 from the sum in Step 7. 
148,202 — 145,656 = 2546 
Step 10. Add the values obtained in Step 5 and Step 9. 
2117 + 2546 = 4663 


Step 11. Divide the value obtained in Step 10 by (m + mz) — 2. 
[In the present example, (12 + 14) — 2 = 24.] 


4 
ee = 194 
24 
Step 12. Multiply the value obtained in Step 11 by 1/m + 1/n.. 
(In the present example, this would equal 1/12 + 1/14.) 
13 


1 1 
—+—)]) = 194 X — = 30.0 
i (5 +5) 9 Xx 3A 


Step 13. Take the square root of the value obtained in Step 12. 


V/ 30.0 = 5.48 
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Step 14. Obtain the mean of Group 1 (sum in Step 2 divided by m1) 
and the mean of Group 2 (sum in Step 6 divided by nz). 


1196 
a = 99.67 = mean of Group 1 
a = 102.00 = mean of Group 2 


Step 15. Subtract the mean of Group 1 from the mean of Group 2. 
102.00 — 99.67 = 2.33 


(Note: For computational purposes, only the absolute difference between 
the means is important.) 

Step 16. Divide the value obtained in Step 15 by the value obtained 
in Step 13. This yields the ¢ value. 


Step 17. To determine whether the ¢ value is significant, the degrees 
of freedom (df) must be computed. For a test of significance between two 
means, the df are equal to (m1 + m2) — 2. In the present example, 
(12 + 14) — 2 = 24. The ¢t value which is significant at the .05 level for 
24 df (see Appendix B) is equal to 2.064. Since the ¢ value in the present 
example is less than 2.064, it is concluded that there is no significant 
difference between the IQ scores of boys and girls in this particular class. 


SECTION 1.6 


The t-Test for Related Measures 


difference between two Sac means. It is most commonly used in 
this way when two scores are recorded forthe same individuals. For in- 
stance, IQ scores might be taken at the beginning and end of a special 
training program to determine if there has been any improvement in test 
scores. The second use of f this test is in the instance where pairs of subjects 


in two different groups are “matched” on the e basis of some variable—like 


age, Sex, race, years Of education, etc.—to ensure that the pairs of subjects 
in each group are the “same” before experimental manipulations are begun. 
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Points to Consider When Using the t for Related Measures 


1. Both experimental groups will have the same number of measures 
since they represent two measures on the same subjects or matched 
pairs of subjects. 

2. If two measures are taken on the same subjects, the treatments- 
by-subjects analysis (see Section 2.5) is usually more appropriate. 


EXAMPLE 


This example is taken from the field of education. Assume that the 
experimenter is interested in determining the effects of a special education 
program on the intelligence test scores of underprivileged children. His 
first step is to match several pairs of students on the basis of their Wechsler 
Intelligence Test scores. One student from each pair is randomly assigned 
to either the special training group or the control group that receives no 
special treatment; the remaining student in each pair is assigned to the 
other group. After six weeks of training, an alternate form of the Wechsler 
test is given to the students in both groups to determine the effects of the 
program. The score recorded for each student is his score on this second 
test. In the present example, the pairs of matched subjects will be repre- 
sented by S and 5S’; the test score of each S by X; and the test score of 
each S’ by Y. 

There are two formulas that are used for the ¢ for related measures. 
The first involves computation of a correlation and is given by 


xX -—Y 


t = : 
Sx? - Sy? — 2rSxSy 
V N 


= variance of the X scores 
variance of the Y scores 
ry = correlation between X and Y 
= number of pairs of scores 


= 
a 
) 
= 
o 
fa) 
a 
| 


uw! 
ue 
I 


= 
| 


The second formula, which gives exactly the same results, is much simpler 


and will be used to demonstrate the computational steps. - 


——— a 


x7 

zs: IO DDL 

De ae 
N(N — 1) 


where D = difference score between each X and Y pair 
N = number of pairs of scores 


Step 1. Table the data as follows. No particular order is necessary, 
except that each pair (S and S’) of scores must be in the same relative 
position. 
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Group 1 Group 2 
(No Special Treatment ) (Special Treatment ) 
Subject Score Subject Score 
St 89 % 94 
ES 86 gs 94 
iS 96 Be 101 
Ss 100 iS, 105 
Ss 94 S; 100 
Ss 86 8’, 84 
S 81 ce 81 
S 93 s. 96 
S 87 Ss; 90 
Sto 89 oe 88 
Su 110 Sa 115 
Sis 95 Fh 100 
Se 107 6) 110 
Sui 96 Si 102 


Step 2. Obtain the difference between each pair of scores. 


89 — 94 = —5 
86 — 94 = —8 
96.— 101 =.—5 
100 — 105 = —5 
94 — 100 = —6 


86 — 84 = +2 
81—8l= 0 
03: — 96, .—3 
87 — 90 = —3 
89 — 88 = +1 
110 = 735 = —5 
95 — 100 = —5 


107 — 110 = —3 
96 — 102 = —6 


Step 3. Square all the difference scores recorded in Step 2, and add 
these squared values. 


Ce 6 Fete 8)? ease ht. (—G)P = 203 


Step 4. Obtain the algebraic sum of the difference scores obtained 
in Step 2. Square this value, and divide by the number of difference scores 
recorded. 


(—5) + (8) | ee ee 


— 512 2601 
14 ee 


= 186 
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Step 5. Subtract the value obtained in Step 4 from the sum in Step 3. 
293 — 186 = 107 


Step 6. Divide the value obtained in Step 5 by N — 1. (In the present 
example, this is 14 — 1 = 13, since N refers to pairs of scores.) 


Step 7. Take the square root of the value obtained in Step 6. 


V 8.23 = 2.87 


Step 8. Divide the value of Step 7 by +~/N. (In the present example, 
/14 = 3.74.) 


Step 9. Obtain the mean score of each of the two groups—that is, 
add all the scores in each group and divide each sum by the number of 
scores added to obtain it. 


89 + 86 + --+ + 96 = 1309 = sum for Group 1 
94 + 94 + --- + 102 = 1360 = sum for Group 2 


1309 
ees 93.50 = mean for Group 1 
1360 
<7 eal 97.14 = mean for Group 2 


Step 10. Subtract the mean for Group 2 from the mean for Group 1. 
93.50 — 97.14 = 3.64 


(Note: For computational purposes, only the absolute difference between 
the means is important.) 


Step 11. Divide the value obtained in Step 10 by the value obtained 
in Step 8. This yields the ¢ value. 


t= ie = 4.74 
.767 

Step 12. To determine whether the ¢ value is significant, the degrees 
of freedom (df) must first be obtained. For the ¢ for related measures, 
the df = N — 1 where N is the number of pairs of scores. In the present 
example, N — 1 = 13. From the ¢ tables (see Appendix B), we find that 
the ¢ value that is significant at the .05 level for 13 df is 2.16. Since the 
obtained ¢ is larger than 2.16, it is concluded that the special training pro- 
gram improved the IQ test scores. 


PART 2 


Analysis of Variance 


The statistical tests presented in the previous sections are designed 
to determine the significance of a difference between two groups. In actual 
practice, however, most experiments involve more than two groups. While 
it would be possible to test the difference between, say, four experimental 
groups by using t-tests of all possible combinations of two group means, 
the number of tests necessary to make these comparisons would be large. 
(The actual number of tests is equal to N(N — 1)/2. In the case of an 
experiment involving four experimental groups, six separate tests would 
be needed. ) 

In addition to posing computational problems, many multigroup 
experiments require that several variables be manipulated at the same 
time. For example, four groups of subjects might be presented with a 
learning task and their performance recorded over a series of several trials. 
The experimenter would very likely be interested not only in overall per- 
formance but also in whether the rate of learning of the several groups was 
the same. To determine this, he needs statistical procedures that are far 
more complex than the simple, two-group ¢ statistic. 

In the following sections, several statistical analyses are introduced 
that permit evaluation of much more complicated experimental designs. 
To aid the user in determining which analysis is appropriate for a particular 
experimental design, a descriptive list of all the analyses is presented below. 
In addition to indicating the type of problem for which each analysis is 


appropriate, the list also indicates some of the major strengths and weak- 
nesses of each. 
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Completely Randomized Design (Section 2.1) 


This design is basically an extension of the t-test to experiments in- 
volving three or more groups. This design would typically be used, for 
example, if an experimenter were interested in determining reactions to 
several different drugs. In this case, subjects would be randomly assigned 
to the several groups and a different drug administered to each group. 
After the performance of subjects in all groups had been measured, sta- 
tistical analyses of the data would be undertaken to determine the differ- 
ential effects of the drugs. 


Factorial Design: Two Factors (Section 2.2) 


This extension of the completely randomized design permits investi- 
gation of one set of variables in combination with some other set. For 
example, instead of being interested only in the effects of drugs, an experi- 
menter might be interested in determining the effects of drugs in combi- 
nation with varying amounts of sleep loss. In the simplest case, two drugs, 
A and B, would be paired with no sleep loss versus twenty-four-hour loss. 
This would result in the formation of four groups: Group 1—Drug A and 
no sleep loss; Group 2—Drug A and twenty-four-hour loss; Group 3—Drug 
B and no sleep loss; Group 4—Drug B and twenty-four-hour loss. Thus, 
it is possible to determine not only the effects of drugs and sleep loss but 
also whether the effects of Drugs A and B were enhanced or suppressed 
by sleep loss. Stated another way, it is possible to determine whether the 
variables interact. 

The experimental procedure for the two-factor design is basically the 
same as for the completely randomized design. The subjects would be 
randomly assigned to the four (in this example) groups, sleep loss would 
be manipulated, and then the drugs would be administered. Again, after 
measuring performance, statistical analyses of the data would be under- 
taken. 


Factorial Design: Three Factors (Section 2.3) 


This is a commonly used extension of the two-factor design. The only 
difference is that a third factor or dimension is added. For example, an 
experimenter working with Drugs A and B and sleep versus sleep loss 
might also be interested in determining the effects of these factors in 
combination with a third factor, alcohol concentration in the blood. If he 
used only two concentrations, 0.0 and 0.2 per cent, the experimental groups 
would be constituted as follows: Group 1—Drug A, no sleep loss, no alcohol; 
Group 2—Drug A, no sleep loss, alcohol; Group 3—Drug A, sleep loss, 
no alcohol; Group 4—Drug A, sleep loss, alcohol. Groups 5, 6, 7, and 8 
would receive the above combinations of sleep loss and alcohol in combi- 
nation with Drug B. The assignment of subjects, measurement of per- 
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formance, and analysis of the results are basically the same as in the 
two-factor design. 


Treatments-by-Levels Design (Section 2.4) 


This represents a slight variation on the two-factor design discussed 
above. All the computations needed to analyze the treatmenits-by-levels 
design are the same as for the two-factor design; the only difference is in 
the intent of the design and interpretation of the results. In the treatments- 
by-levels, one of the factors usually represents some variable already known 
to affect performance. For example, if it were known that sleep loss gener- 
ally heightens the effects of drugs, it would probably be wise for the 
experimenter to include different levels of sleep loss as a variable in his 
drug experiments. By so doing, variability due to the specific effects of 
different amounts of sleep loss could be statistically separated from the 
effects of the drugs. 


Treatments-by-Subjects, or Repeated-Measures, Design (Section 2.5) 


The treatments-by-subjects design is a variation of the completely 
randomized design. Instead of using several different groups of subjects 
with each group receiving a single drug, only one group of subjects would 
be used and each subject would receive all the drug treatments. If the 
treatments-by-subjects design were to be used for the drug experiment, the 
single group of subjects would probably receive one drug, perform the 
criterion task, and wait until the effects wore off. Then a second drug 
would be administered, the criterion task would be performed, and another 
waiting period would ensue. This same procedure would be repeated until 
every subject in the group had received every drug. Analysis of the findings 
would be based on the subjects’ performance while under the influence of 
the several drugs. The major advantage of this design over the completely 
randomized design is that fewer numbers of subjects are required.! The 
major disadvantage is that there might be carry-over effects from one 
treatment to the next. In the present example, it is possible that exposure 
to one drug would heighten or lessen sensitivity to other drugs administered 
later. Also, the subjects might become progressively more proficient at 
performing the criterion task and show an improvement in performance 
that would be due to learning and not to the effects of the drugs. 


Treatments-by-Treatments-by-Subjects Design (Section 2.6) 


This two-factor design bears the same relationship to the treatments- 
by-subjects design as the factorial bears to the completely randomized 


1 Very often the advantage of increased statistical power is also gained by using a repeated-measures 
design. The reason for this is that the random variability of a single subject from one measuring period to 
the next is usually much less than the variability introduced by measuring and comparing different subjects. 
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design. The treatments-by-treatments-by-subjects design is basically the 
same as the two-factor factorial design, with one notable exception. Instead 
of different subjects being assigned to the experimental groups, one group 
of subjects performs under all experimental conditions. Using the example 
from the two-factor factorial design, an experiment using the treatments- 
by-treatments-by-subjects design would probably be conducted as follows. 
First, all subjects would receive Drug A with no prior sleep loss, perform 
the criterion task, and then wait for the effects to wear off. After a suitable 
period, the same subjects would again receive Drug A, but this time the 
drug would follow a twenty-four-hour sleep loss. After performance meas- 
ures had been recorded and a sufficient period allowed for the effects of 
the drug to wear off, the same procedures would be repeated with Drug B. 
The major advantage of this design over the factorial is that far fewer 
subjects are required. As in the treatments-by-subjects design, the major 
disadvantage is that there may be carry-over effects from one treatment to 
the next. 


Two-Factor Mixed Design: Repeated Measures on One Factor (Section 2.7) 


This design is essentially a combination of the completely randomized 
and treatments-by-subjects designs. It involves the assignment of subjects 
to several experimental groups. However, instead of taking only one meas- 
ure, as in the completely randomized design, the performance of the 
subjects would be measured repeatedly to determine the effects of the 
experimental variables over a prolonged period of time. This recording of 
repeated measures is, of course, identical with the procedure used in the 
treatments-by-subjects design. 

To further clarify, let us continue with the example used to illustrate 
the completely randomized design. In the two-factor mixed design, subjects 
would again be assigned to the several experimental groups, and each 
group would be administered a different drug. Then, the subjects’ per- 
formance on the criterion task would be measured several times. 

Since measures are recorded over several successive test periods, this 
design permits (1) comparison of the overall performance of the experi- 
mental groups (as in the completely randomized design), (2) evaluation 
of performance changes from one measuring period to the next (as in the 
treatments-by-subjects design), and (3) evaluation of the drug effects in 
relation to the passage of time between measuring periods. This particular 
design is very widely used in research in the behavioral sciences. 


Three-Factor Mixed Design: Repeated Measures on One Factor (Section 2.8) 


This extension of the two-factor mixed design is essentially a combi- 
nation of the factorial and repeated-measures designs. In the three-factor 
mixed design, the experimental groups are formed and subjects are assigned 
in exactly the same manner as in the factorial design. The basic difference 
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(using the example of the factorial design) is that the effects of the drugs 
in combination with sleep loss would be measured several times rather 
than only once. Consequently, this design permits not only the evaluation 
of the overall experimental effects (as in the factorial design) but also the 
evaluation of general changes and interactions of the variables over the 
passage of time (as in the repeated-measures designs). 

This particular design is probably the one used most often in be- 
havioral science research. There are several slight variations of the format 
presented here, the most common of which involves presenting subjects 
with a task to be learned during a predetermined set of practice trials. 
In this situation, the repeated measures represent the learning rates of the 
subjects in the several experimental groups. 


Three-Factor Mixed Design: Repeated Measures on Two Factors (Section 2.9) 


This design is essentially a combination of the completely randomized 
and the treatments-by-treatments-by-subjects designs. As in the com- 
pletely randomized design, subjects are randomly assigned to two or more 
experimental groups. For example, one group might be subjected to a 
twenty-four-hour sleep loss just prior to the experiment and the other 
group to no sleep loss. Each of these different groups would then be treated 
in the same fashion as in the treatments-by-treatments-by-subjects design. 
That is, two additional factors (say, Drug A versus Drug B and 0.0 versus 
0.2 per cent alcohol) would be combined and presented to each subject in 
both of the experimental groups. Consequently, all subjects in the sleep-loss 
and no-sleep-loss groups would receive Drug A with no alcohol, perform the 
criterion task, wait for the effects to dissipate, then receive Drug A with 
alcohol, etc., until all variable combinations had been experienced. The 
major advantage of the three-factor mixed design over the regular three- 
factor design discussed above is that many fewer subjects are required to 
conduct the experiment. Carry-over effects probably represent the most 
serious drawback. 


Latin Square Design: Simple (Section 2.10) 


This design is a variation of the treatments-by-subjects, or repeated- 
measures, design. The basic difference in the Latin square design is that 
the presentation of the treatments is deliberately counterbalanced. Thus, 
instead of giving subjects the various drugs in the same order (Drug A, 
then B, then C, etc.) or randomly assigning the order of presentation of 
the drugs for each subject, a systematic order of presentations is set up 
so that order and carry-over effects can be ascertained. Assume that three 
drugs are to be investigated. If the simple Latin square design were to be 
used, one third of the subjects would receive Drug A first, then B, then C; 
a second third would receive Drug C first, then A, then B; and the final 
third would receive Drug B first, then C, then A. As indicated above, this 
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design permits the analysis not only of the effects of the drugs but also of 
the order in which they were given. 


Latin Square Design: Complex (Section 2.11) 


This design can be viewed as a variation of the two-factor mixed 
design or as an extension of the simple Latin square. As in the two-factor 
mixed design, subjects would be randomly assigned to different experi- 
mental groups (like sleep loss versus no sleep loss). The drugs would then 
be administered to all subjects in both groups in the same manner as in the 
simple Latin square. Thus, one third of the subjects in the no-sleep-loss 
group would receive Drug A, then B, then C; a second third would receive 
Drug C, then A, then B; and a final third would receive Drug B, then C, 
then A. The same procedure would be used with the subjects in the sleep- 
loss group. Thus, this design permits not only the evaluation of the effects 
of the drugs and of sleep loss but also the evaluation of the effects of the 
order of drug administration in relation to the other two factors. 


In Parts 2 and 3 of this book, only the verbal instructions for com- 
puting the analyses and the computed examples are presented. In place 
of symbols and formulas, the textbook sources of the several analyses are 
listed at the beginning of each section. The reasons for this are twofold. 
First, several of the more complex analyses require up to twenty separate 
computational formulas, plus additional ones for retabling the data. Second, 
and more important, there is no standard set of terms and symbols to 
indicate analysis-of-variance operations. These tend to be specific to each 
text, and translation from one text to another is difficult. To include all 
the symbols and terms currently in use or to develop a set of our own is 
beyond the scope of this book. 

In Part 3, specific supplemental computations and the uses of multiple 
comparisons employed in conjunction with analyses of variance are dis- 
cussed. Because of the relative specificity of these computations, the reader 
is encouraged to read the introductory comments at the beginning of Part 
3 to determine whether a particular test is appropriate to his experimental 
findings. 
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SECTION 2.1 
Completely Randomized Design 


One of the more simple experimental designs that permit comparison 
of several groups is the simple randomized, or completely randomized, design. 
This design is known by various names and is treated in the following 
statistics textbooks. 


Carlborg, F. W. Introduction to Statistics. Glenview, Ill.: Scott, Foresman 
and Company, 1968. Chapter 7, pp. 208-223. 

Cochran, W. G., and Cox, G. M. Experimental Designs, 2nd ed. New York: 
John Wiley & Sons, Inc., 1957. Chapter 4, pp. 95-97. 

Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 9, pp. 
117-125. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 3, 
pp. 47-66. 

McNemar, Q. Psychological Statistics, 3rd. ed. New York: John Wiley & 
Sons, Inc., 1962. Chapter 15, pp. 252-270. 

Ray, W.S. Statzstics in Psychological Research. New York: The Macmillan 
Company, 1962. Chapter 15, pp. 254-262. 

Walker, H. M., and Lev, J. Statistical Inference. New York: Holt, Rinehart 
& Winston, 1953. Chapter 9, pp. 196-216. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 3, pp. 56-70. 


Points to Consider When Using the Completely Randomized Design 


1. For each subject in the experimental groups, there can be only 
one score. If many measures are taken for each subject, these 
measures must be combined in some fashion (added, etc.) so that 
there is only one score for each subject. 

2. Although it is not necessary, it is usually best to have an equal 
number of subjects in each of the experimental groups. In most 
experiments, ten to fifteen subjects per group are used. 

3. The number of experimental groups that may be compared is 
arbitrary. However, it is rare that more than four or five groups 
are compared in one experiment. 


EXAMPLE 


The example used to demonstrate the computational procedures is 
drawn from psychology. Assume that the experimenter is interested in 
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determining the effect of shock on the time required to solve a set of 
difficult problems. Subjects are randomly assigned to four experimental 
conditions. Subjects in Group 1 receive no shock; Group 2, very-low- 
intensity shocks; Group 3, medium shocks; and Group 4, high-intensity 
shocks. The total time required to solve all the problems is the measure 
recorded for each subject. 

Step 1. After the experiment has been conducted and the data 
collected, table the data as follows. 


Group 1 Group 2 Group 3 Group 4 

(No Shock ) (Low Shock) (Medium Shock) (High Shock ) 

Time Time Time Time 

Subject (min.) Subject (min.) Subject (min.) Subject (min.) 
Si 10 Sis 3 S25 19 S37 23 
S» 7 Sis 8 Soe 12 Ss 14 
S3 9 Sis G So7 16 S39 16 
S4 8 Sis 5 Sog 14 S40 18 
Ss 15 Siz 6 S29 uf Sa 12 
Ss 2 Sis 10 S30 8 Sa 13 
S7 8 Sig 12 Ss 13 Sas 16 
Ss 9 S29 4 S30 10 S44 17 
Sy 11 So a S33 19 S45 19 
S10 9 Sx 6 S34 9 Sus 14 
Su 5 So3 5 S35 15 Saz 16 
S12 17 So4 15 S36 14 Sas W/ 


Step 2. Add the scores in each group to get the sum of each group. 
(Note: If you are using a calculator, Steps 2 and 3 can be done at the same 
time.) 


Group1 Group2 Group 3 Group 4 


10 3 19 oe 
7 8 12 14 
Sums: 111 88 156 195 


Step 3. Square each number in the table, and add these squared 
values together. 


102+ 72+ +e HIT + 324-87 + +++ + 15% + 19? 
+ 1224 +++ + 142 4 23? 4 1424 +--+ + 17? = 7434 
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Step 4. Add all the group sums (Step 2) together to obtain a grand 
total for the entire table. 


111 + 88 + 156 + 195 = 550 


Step 5. Square the grand total (Step 4), and divide the squared 
value by the total number of measures recorded (see Step 1). (In the 
present example, the latter number is 48, since there are 4 groups of 12 
subjects each.) The value obtained is the correction term. 


550? 302,500 
err as 


= 6302 


Step 6. Subtract the correction term (Step 5) from the sum of the 
squared values obtained in Step 3. The resultant value is the swum of squares 
total, or SS. 


7434 — 6302 = 1132 
Step 7. Square the sum of each of the groups (Step 2), divide by 
the number of measures in each group, and then add these values. 
lil? 88?» 156? . 195°4; 82,406 
aie 12 oe 7 


= 6869 


Step 8. Subtract the correction term (Step 5) from the value ob- 
tained in Step 7. The resultant value is the sum of squares between groups, 
or SSp. 

6869 — 6302 = 567 


Step 9. Subtract the sum of squares between groups (Step 8) from 
the sum of squares total (Step 6). This yields the sum of squares within 
groups, or SSy. 


1132 — 567 = 565 


Step 10. All computations based directly on the data have now been 
completed. However, since the test of significance (F-test) is a ratio of 
the mean squares, these values must be computed. To compute the needed 
mean squares, the degrees of freedom (df) for each of the components 
(SS, SSz, and SS,) must be determined, as follows. 


df for SS; = the total number of measures (see Step 1) 
minus 1. 


48 — 1 = 47 


df for SSp = the number of experimental groups minus 1. 


4—1=3 


df for SS, = the total df minus the between df. 
47 —3 = 44 
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Step 11. The mean squares are then computed as SS/df. 


SS ; < 
ms; = - (This value is not needed for the analysis. ) 
SS, _ (Step 8) — 567 
ms, = af = 3 aaa 189 
eae SS, (Step9) 565 | io wt 
mae “Eiif ae 


Step 13. Table the final analysis as follows. 


Source 


Total 
Between groups 
Within groups 


SS df ms F p 


1132 47 — = = 
567 3 189 14.71 <.001 
565 44 12.84 — — 


Since the F value (see Appendix D) of 14.71, with df of 3 and 44, 
would occur by chance less than once in one thousand times, it is concluded 
that level of shock intensity does affect the time required to solve these 


problems. 


SECTION 2.2 


Factorial Design: Two Factors 


Many times an experimenter wishes to determine the effects of two 
variables in combination with each other. For example, instead of investi- 
gating the effects of differing list«difficulty on performance (memorizing 
the lists) in one experiment and then doing another experiment to determine 
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the effects of varying room noise on performance, he may well wish to: 
investigate these variables in combination with each other. The two-factor 
design, which permits such comparisons, is discussed in the following 
textbooks. 


Carlborg, F. W. Introduction to Statistics. Glenview, Ill.: Scott, Foresman 
and Company, 1968. Chapter 7, pp. 242-251. 

Cochran, W. G., and Cox, G. M. Experimental Designs, 2nd ed. New York: 
John Wiley & Sons, Inc., 1957. Chapter 5, pp. 148-155. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 9, 
pp. 207-219. 

McNemar, Q. Psychological Statistics, 3rd ed. New York: John Wiley & 
Sons, Inc., 1962. Chapter 16, pp. 303-317. 

Walker, H. M., and Lev, J. Statistical Inference. New York: Holt, Rinehart 
& Winston, Inc., 1953. Chapter 14, pp. 348-363. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 5, pp. 140-162, 228-247. 


Points to Consider When Using the Two-Factor Factorial Design 


1. For each subject in the experimental groups, there can be only 
one score. As in the simple randomized design, if many measures 
are taken for each subject, these must be combined (added, etc.) 
so that there is only one score for each subject. 

2. It is usually best to have an equal number of subjects in each 
of the experimental groups. If equality cannot be obtained, the 
number of subjects in each of the groups should be proportional. 
In most experiments, ten to fifteen subjects per group are used. 

3. The number of treatment groups within each factor that may be 
compared is arbitrary. However, it is rare that more than four or 
five groups are included in either of the two factors. 


EXAMPLE 


The example used to demonstrate the computational procedures is 
drawn from psychology. Assume that an experimenter is interested in 
determining the effects of high- versus low-intensity shock on the memori- 
zation of a hard versus an easy list of nonsense syllables. Subjects are 
randomly assigned to four experimental conditions. Subjects in Group 1 
receive periodic low-intensity shocks and must memorize an easy list; 
Group 2, high shock and an easy list; Group 3, low shock and a hard list; 
and Group 4, high shock and a hard list. The total number of errors made 
by each subject is the measure recorded. 
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Step 1. After the experiment has been conducted, table the data as 

follows. (Note: If more than a2 X 2 factorial—e.g., a2 X 3,3 X 3, ete.—is 

to be analyzed, simply table the additional treatment groups in their 
appropriate row or column. All other steps are the same.) 


Group 1 Group 2 
(Low Shock—Kasy List) (High Shock—Kasy List) 
Subject No. of Errors Subject No. of Errors 
Sy 9 S7 15 
So 16 Ss 13 
S3 14 So 9 
S4 11 Siro 9 
Ss 8 Si2 il 
Group 3 Group 4 
(Low Shock—Hard List) (High Shock—Hard List) 
Si3 10 Sig 19 
S14 12 Soo 16 
Sis 18 Sor 18 
Sig 16 Soo 23 
Si 17 Sos 14 
Sig 15 Soa 15 


Step 2. Add the scores in each group. (Note: If you are using a calcu- 
lator, Steps 2 and 3 can be done at the same time.) 


Group 1 Group2 Group3 Group 4 


9 15 10 19 
16 13 We; 16 
Sums: 70 65 88 105 


Step 3. Square each number in the entire table (Step 1), and add 
these squared values. 


Q? + 162+ --- + 15% 4+ 13?+ +++ + 10? + 1224 --- + 19° 
+ 16? -+ +++ + 15% = 4832 


Step 4. Add the sums of all the groups (Step 2) to get the grand sum 
of the entire table. 


70 + 65 + 88 + 105 = 328 


28 / Parl 2 Analysis of Variance 


Then, square this value, and divide by the total number of measures re- 
corded in the table (see Step 1). This yields the correction term. 
328? 107,584 


= = 4483 
24 24 


Step 5. Computation of the total sum of squares (SS;): Simply 
subtract the correction term (Step 4) from the sum of the squared measures 
(Step 3). 

4832 — 4483 = 349 = SS; 

Step 6. Computation of the effects of the first factor (the overall 
effects of low shock versus high shock): First, add the sums of the two 
shock groups (see Step 2), disregarding the difficulty-of-list dimension. 


70 + 88 = 158 = sum of the low-shock groups 
65 + 105 = 170 = sum of the high-shock groups 


Then, square the above sums, divide by the number of measures on which 
each of the sums was based, and add the quotients. 
158? te 170? 53,864 
12 ie 


= 4489 


Then, subtract the correction term from the above value. 
4489 — 4483 = 6 = SSshock 


Step 7. Computation of the effects of the second factor (the overall 
effects of hard versus easy list): First, add the sums of the two same-list- 
difficulty groups (see Step 2), disregarding the shock dimension. 


70 + 65 = 135 = sum of easy-list groups 
88 + 105 = 193 = sum of hard-list groups 


Then, square the above sums, divide by the number of measures on which 
each of the sums was based, and add the quotients. 
135? 193? 55,474 
12 aS b 


= 4623 


Then, subtract the correction term from the above value. 
4623 — 4483 = 140 = SSist 


Step 8. Computation of the interactive effects of shock and list 
difficulty: First, square the sums of each of the experimental groups 
(Step 2), divide by the number of measures on which each sum was based, 
and then add the quotients. 

70? Ei 65° 88 , 105° 27,894 


6: Be 6. at eae 
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Then, from this value, subtract the correction term (Step 4), SSchock 
(Step 6), and SSist (Step 7). 


4649 — 4483 — 6 — 140 = 20 = SSghock x list 
Step 9. Computation of the error-term sum of squares (SSerror) : 


Simply subtract SSshock (Step 6), SSist (Step 7), and SSshock x1ist (Step 8) 
from SStotai (Step 5). 


349 — 6 — 140 — 20 = 183 = SSancn 


Step 10. All computations based directly on the data have now been 
completed. However, since the F ratios are ratios of mean squares, the 
degrees of freedom (df) for each of the components must be computed. 


df for SS; = the total number of measures (see Step 1) 


minus 1. 
24 —1= 23 

df for SSshock = the number of shock conditions minus 1. 
2—1=1 

df for SSiss = the number of list conditions minus 1. 
2 = 1 

df for SSshock x ist = the df for SSshock times the df for SSiist. 
LX 1 


df for SSeror = the df for SS; minus the df for SSshock, SSist, 
and SSshock x list: 


28 —i—1—1=20 
Step 11. The mean squares are then computed as SS/df. 


ms; (This value is not needed for the analysis. ) 
Se (Step Bjop Grin 
MSshock = 1 a: 1 = 
Step 7 140 
MS\ist = eines = = 140 
1 1 
(Step 8) 20 
MS§shock X list = a = = 20 
1 1 
ae iy (Step 9) E 183 Ea 


20 20 
Step 12. The several F ratios are then computed as 


MSshock MSlist MSshock list 


MSerror MSerror MSerror 
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Step 13. Table the final analysis as follows. 


Source ss df ms F p 
Total 349 23 — — — 
Shock 6 1 6 . 66 nee 
List 140 1 140 15.30 <.001 
Shock X List 20 1 20 2.19 n.s. 
Error 183 20 9.15 — —_ 


Therefore, we conclude (see Appendix D) that shock had no significant 
effect. on performance and that the interaction of shock by list difficulty 
was also nonsignificant. However, the effect of list difficulty was significant 
and would be expected to occur by chance less than once in one thousand 
times. 


SECTION 2.3 
Factorial Design: Three Factors 


This design is a commonly used extension of the two-factor design 
discussed in Section 2.2. The one basic difference is that instead of de- 
termining the effects of two variables in combination with each other, 
this design permits evaluation of three variables. The three-factor design 
is discussed in the following textbooks. 


Cochran, W. G., and Cox, G. M. Experimental Designs, 2nd ed. New York: 
John Wiley & Sons, Inc., 1957. Chapter 5, pp. 155-156. 

Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 12, pp. 
175-210. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 10, 
p. 243. 

McNemar, Q. Psychological Statistics, 3rd ed. New York: John Wiley & 
Sons, Inc., 1962. Chapter 16, pp. 318-338. 
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Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 5, pp. 162-174, 248-263. 


Points to Consider When Using the Three-Factor Factorial Design 


1. For each subject in the experimental groups, there can be only 
one score. As in the two-factor design, if many measures are taken 
for each subject, these must be combined (added, etc.) so that 
there is only one score for each subject. 

2. It is usually best to have an equal number of subjects in each 
experimental group. In most experiments, ten to fifteen subjects 
per group are used. 

3. The number of treatment groups within each factor that may be 
compared is arbitrary. However, it is rare that more than four or 
five groups are included in any of the factors. 


EXAMPLE 


The example used to demonstrate the computational procedures is 
drawn from the field of psychology and is essentially an extension of the 
one used in Section 2.2. Assume that the experimenter, in addition to 
determining the effects of high- versus low-intensity shock on the memori- 
zation of easy versus difficult lists, is also concerned with determining the 
effects of rate of list presentation on learning in the above conditions. 
Obviously, the experimenter could conduct one two-factor experiment at 
a fast rate of presentation and another at a slow rate, or he could include 
rate of presentation as an additional dimension and conduct the entire 
experiment as one three-factor design. 

In the present example, then, the variables are high versus low shock, 
hard versus easy list, and fast versus slow rate of presentation. Subjects 
are randomly assigned to one of eight experimental conditions. Subjects 
in Group 1 receive periodic low-intensity shock and must memorize an 
easy list presented at a slow rate; Group 2—low-intensity shock, easy list, 
fast rate; Group 3—low-intensity shock, hard list, slow rate; Group 4—low- 
intensity shock, hard list, fast rate. Groups 5, 6, 7, and 8 receive the same 
treatment as Groups 1, 2, 3, and 4, except that high-intensity shocks are 
administered: Group 5—high-intensity shock, easy list, slow rate; Group 
6—high-intensity shock, easy list, fast rate; Group 7—high-intensity shock, 
hard list, slow rate; Group 8—high-intensity shock, hard list, fast rate. 

The total number of errors made by each subject is the measure 
recorded. 

Step 1. After the experiment has been completed, table the data as 
follows. (Note: If other than a 2 X 2 X 2 factorial—e.g., 2 K 2 X 3, 
3 X 2 X 3, etc.—is to be analyzed; simply table the additional treatment 
groups in their appropriate row or column. All other steps are the same.) 
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Group 1 Group 2 Group 3 Group 4 
(Low, Easy, (Low, Easy, (Low, Hard, (Low, Hard, 
Slow ) Fast ) Slow ) Fast ) 

No. of No. of No. of No. of 

Subject Errors Subject Errors Subject Errors Subject Errors 
Sy 15 S7 23 S13 11 Sig 25 
So 8 Ss 16 S14 16 S20 27 
S3 9 So 17 Sis 8 So 29 
S4 if S10 17 Si6 14 Soo 34 
Ss 8 Su 14 Siz 20 Sos 238 
Se 4 Sie 11 Sis 16 So 26 

Group 5 Group 6 Group 7 Group 8 
(High, Easy, (High, Easy, (High, Hard, (High, Hard, 
Slow) Fast ) Slow) Fast ) 

Sos 14 S31 24 S37 11 S43 39 
Soe 6 S32 16 S3s 17 Sag 32 
Sor 3 S33 10 S39 12 Sas 38 
Sog 5 S34 18 Sao 14 Sas 39 
Soo 6 S35 13 Say 21 Sar 33 
S30 7 S36 17 Sao 18 Sas 31 


Step 2. Add the scores in each group. (Note: If you are using a calcu- 
lator, Step 2 and Step 3 can be done at the same time.) 


Group 1 Group2 Group3 Group 4 


15 23 11 25 
8 16 16 27 
Sums: 51 98 85 179 


Group 5 Group6 Group7 Group 8 


14 24 11 39 
6 16 17 32 
Sums: 41 98 93 212 


Step 3. Square each number in the entire table (Step 1), and add 
these squared values. 


15? + 8 + --- + 31? = 20,083 
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Step 4. Add all the group sums (Step 2) to get the grand sum of 
the entire table. 
51 + 98 + 85 + 179 + 41 + 98 + 93 + 212 = 857 


Then, square the above value and divide by the number of scores added 
(recorded in Step 1) to obtain the grand sum. (In the present example, 
48 scores were added.) This yields the correction term. 


8572 734,449 
AS | © 48 


= 15,301 


Step 5. Computation of the total sum of squares (SS,): Simply 
subtract the correction term (Step 4) from the sum of the squared measures 
(Step 3). 

20,083 — 15,301 = 4782 = SS; 


Step 6. Computation of the effects of the first factor (the overall 
effects of high versus low shock): First, add the scores of the two same- 
intensity-shock groups (see Step 2), disregarding the difficulty-of-list and 
rate-of-presentation dimensions. 


51 + 98 + 85 + 179 = 413 
41 + 98 + 93 + 212 = 444 


sum of the low-shock groups 


sum of the high-shock groups 


Then, square the above sums, divide by the number of measures on which 
each of the sums was based, and add the quotients. 
413? a 4442 367,705 
24 2) es 


= 15,321 


Then, subtract the correction term (Step 4) from the above value. 
Py ePAll <a 15,301 — 20 at SSshock 


Step 7. Computation of the effects of the second factor (the overall 
effects of hard versus easy list): First, sum the scores of the two same- 
list-difficulty groups (Step 2), disregarding the shock-intensity and rate- 
of-presentation dimensions. 


51 + 98 + 41 + 98 = 288 = sum of the easy-list groups 
85 + 179 + 93 + 212 = 569 = sum of the hard-list groups 


Then, square the above sums, divide by the number of measures on which 
each was based, and add the quotients. 
288? i 569? _ 406,705 
24 24 8624 


= 16,946 


Then, subtract the correction term (Step 4) from the above value. 


16,946 — 15,301 = 1645 = SSit 
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Step 8. Computation of the effects of the third factor (the overall 
effects of fast versus slow rate of presentation) : First, sum the scores of 
the two same-rate-of-presentation groups (Step 2), disregarding the shock- 
intensity and list-difficulty dimensions. 


51 + 85 + 41 + 93 = 270 = sum of the slow-rate groups 
98 + 179 + 98 + 212 = 587 = sum of the fast-rate groups 
Then, square the above sums, divide by the number of measures on which 
each was based, and add the quotients. 
270? is 587? 2 417,469 
24 24 24 


= 17,394 


Then, subtract the correction term from the above value. 
17,394 — 15,301 = 2093 = SSnte 
Step 9. Computation of the interactive effects of the first and second 
factors (shock X list): First, sum the scores of the groups which have the 


same pairings of shock intensity and list difficulty, disregarding the rate- 
of-presentation dimension. 


51 + 98 = 149 = sum of the low-shock, easy-list groups 
85 + 179 = 264 = sum of the low-shock, hard-list groups 

41 + 98 = 139 = sum of the high-shock, easy-list groups 
93 + 212 = 305 = sum of the high-shock, hard-list groups 


Then, square the above sums, divide by the number of scores on which 
each sum was based, and add the quotients. 
149° s_- 264? in 1389? = 8057. 204,248 
12 12 1 12. ease 


= 17,020 


Then, from this value, subtract the correction term (Step 4), the SSsnocx 
(Step 6), and the SSist (Step 7). 


17,020 — 15,3801 — 20 — 1645 = 54 = SSshock xiist 
Step 10. Computation of the interactive effects of the first and third 
factors (shock X rate of presentation) : First, sum the scores of the groups 


that have the same pairings of shock intensity and rate of presentation. 
Disregard the difficulty-of-list dimension. 


51 + 85 = 136 = sum of the low-shock, slow-rate groups 
98 + 179 = 277 = sum of the low-shock, fast-rate groups 

41 + 93 = 134 = sum of the high-shock, slow-rate groups 
98 + 212 = 310 = sum of the high-shock, fast-rate groups 


Then, square the above sums, divide by the number of scores on which 
each is based, and add the quotients. 


1362 - O77? " 1347 310? - 209,281 
12 12 12 (ar a 


= 17,440 
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Then, from the above value, subtract the correction term (Step 4), the 
SSshock (Step 6), and the SSrate (Step 8). 


17,440 — 15,301 — 20 — 2093 = 26 = SSshock x rate 


Step 11. Computation of the interactive effects of the second and 
third factors (difficulty X rate of presentation): First, sum the scores of 
the groups that have the same pairings of difficulty of material and rate of 
presentation. Disregard the shock dimension. 


51+ 41 = 92 = sum of the easy-list, slow-rate groups 
98 + 98 = 196 = sum of the easy-list, fast-rate groups 
85 + 93 = 178 = sum of the hard-list, slow-rate groups 
179 + 212 = 391 = sum of the hard-list, fast-rate groups 


Then, square the above sums, divide by the number of scores on which 
each is based, and add the quotients. 
Got" TOGA) | 1782 58012 231.445 
= + 45 = : 
12 12 NY 12 12 


= 19,287 


Then, from the above value, subtract the correction term (Step 4), the 
SSist (Step 7), and the SSrate (Step 8). 


19,287 — 15,301 — 1645 — 2093 = 248 = SSiist x rate 


Step 12. Computation of the interactive effects of the first, second, 
and third factors (shock X list difficulty < rate of presentation): First, 
square the sums of each of the experimental groups (Step 2), divide by 
the number of measures on which each sum was based, and then add the 
quotients. 

Oe Ger ay byO? .. “Al?” 08 


Gage Pr gu sg 6 6 
932 n 212? 116,349 
6 e-— 


= 19,391 


Then, from this value, subtract the correction term (Step 4), the SSshock 
(Step 6), the SSis (Step 7), the SSrate (Step 8), the SSshock xis; (Step 9), 
the SSshock x rate (Step 10), and the SSiist x rate (Step 11). 


19,391 — 15,301 — 20 — 1645 — 2093 — 54 — 26 — 248 
=4= SSshock X list X rate 


Step 13. Computation of the error-term sum of squares (SSerror) : 
Simply subtract SSshock (Step 6), SSiiss (Step 7), SSrate (Step 8), SSshoek x tist 
(Step 9) ; SSshock x rate (Step 10) ) SSiist x rate (Step 11) ) and SSshock x list X rate 
(Step 12) from the SStota (Step 5). 


4782, — 20 — 1645 — 2093 — 54 — 26 — 248 — 4 = 692 = SScmor 
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Step 14. 


All of the computations based directly on the data have 


been completed. However, since the F ratios are ratios of mean squares, 
the degrees of freedom (df) for each of the components must be computed. 


Step 15. 


df for SS, = the total number of measures (see Step 1) 
minus 1. 
48 — 1 = 47 


df for SSshock = the number of shock conditions minus 1. 


2—1=1 
df for SSis¢ = the number of list difficulties minus 1. . 
Ji = 


df for SSrate = the number of rates of presentation minus 1. 


2—tf=1!1 

df for SSshock x list = the df for shock times the df for list. 
1xX1l=1 

df for SSshock x rate = the df for shock times the df for rate. 
1xXl=1 

df for SSiist x rate = the df for list times the df for rate. 
1xXl=1 


df for SSshock x list X rate = the df for shock times the df for 
list times the df for rate. 


rx LX LS 


df for SSeror = the df for SS; minus the dfs for SSshock, SSiist, 
Srntes SSshock X list, SSiist x ratey SSshock X rate, and SSshock X list X rate- 


46 —1—1] ~1-1—1-—1=-1=4 


The mean squares are then computed as SS/df. 


MS¢ (This value is not needed for the analysis. ) 
Step 6 2 
MSshock = \ a ) = : = 20 
il il 
Step 7 1645 
Msist ag SEND Ute 
1 1 
Step 8 2093 
MSrate = \ = ) = = 2093 


1 t 
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Step 9 
MSshock > list = eee = i = 54 
1 1 
Step 10 26 
MSshock X rate = \ ; ) = ‘ = 26 
Step 11 24 
MSlist x rate ae eet = esis = 248 
1 il 
Step 12 
MSshock X list X rate = iS = : =4 
ih 1 
(Step 13) 692 
MSerror = = = ° 
e 40 0 17.30 


Step 16. The several F ratios are then computed as 


MSshock MSshock list 
MSerror MSerror 
MSlist MSshock X rate 
MSerror MSerror 
MSrate MSlist X rate 
MSerror MSerror 


MSshock X list X rate 


m Serror 


Step 17. Table the final analysis as follows. 


Source Ss df ms F Dp 
Total 4782 47 _— — — 
Shock 20 1 20 1.16 N.S. 
List 1645 1 1645 95.09 <.001 
Rate 2093 1 2093 120.98 <.001 
Shock X list 54 1 54 Sali n.S. 
Shock X rate 26 1 26 150 n.s. 
List X rate 248 1 248 14.34 <.001 
Shock X list X rate 4 1 4 23 N.S. 
Error 692 40 17.30 —_ —_ 


Therefore, it is concluded (see Appendix D) that list difficulty and 


presentation rate affect error making in a word-memorizing situation and, 
also, that the effects of list difficulty and presentation rate are interactive. 
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SECTION 2.4 
Treatments-by-Levels Design 


Occasionally a researcher is faced with a group of subjects who either 
come from distinctly different populations or are tested at different times 
and places. In this case, he might reasonably expect the subjects in the 
various samples to differ in some systematic fashion. To control for this 
source of bias and confusion, a variation of the factorial design, the treat- 
ments-by-levels design, is appropriate. It is discussed in the following 
textbooks.1 


Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 12, pp. 
215-219. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 5, 
pp. 121-155; Chapter 7, pp. 172-189. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 5, pp. 213-216. 


Points to Consider When Using the Treatments-by-Levels Design 


1. For each subject in the experimental groups, there can be only 
one score. As in the factorial designs, if many measures are taken 
for each subject, these must be combined so that there is only one 
score for each subject. 

2. It is best to have an equal number of subjects in each experimental 
group and within each level or replication. In most experiments, 
ten to fifteen subjects per group are used. 

3. The number of treatment groups is arbitrary. The same is true 
of the number of levels or replications employed. However, it is 
rare that more than four or five groups or levels are employed. 


EXAMPLE 


One of the most common uses of the treatments-by-levels design occurs 
in the field of education when children are drawn from various schools that 
differ markedly in quality and location. For this example, assume that an 
experimenter wishes to investigate the effectiveness of three different 
methods of teaching arithmetic. Because he has reason to believe that the 


1 The computational procedures given in this section are the same for all the textbook chapters listed. 
However, the philosophies underlying the various designs presented in these texts differ and should be con- 
sidered before interpretations of the results are made. 
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success of the teaching methods depends on the overall quality of the school 
and the type of students enrolled, he decides to select one school from an 
upper-class neighborhood, another from a middle-class area, and a third 
from a slum area. In each school, one class is taught by the usual teacher- 
only method, a second class by a teacher plus teaching machines, and the 
third by television plus teaching machines. An achievement test is given 
to each student at the beginning of the term and again at the end. The 
score recorded for each student is the amount of improvement (in test 
points) shown. 

Step 1. After the experiment has been completed, table the data as 
follows. 


LEVEL 1 (UPPER-CLASS SCHOOL) 


Group 1 Group 2 Group 3 
(Teacher Only) (Teacher + Machines) (Television + Machines) 
Subject Points Subject Points Subject Points 
Si 74 S7 94 Sis 87 
So 79 Ss 96 Sia 76 
S3 94 So 92 S15 94 
S4 90 Sio 84 Sig 92 
Ss 88 Su 85 Si7 98 
Se 87 Sie 89 Sig 71 


LEVEL 2 (MIDDLE-CLASS SCHOOL) 


Group 4 Group 5 Group 6 
Sig 70 Sos 76 S31 70 
Soo 78 So 91 S32 86 
Sa 96 Sez 94 S33 91 
Soo 86 Sos 86 S34 74 
So3 80 Sag 87 S35 88 
Sos 92 S30 91 S36 77 


LEVEL 3 (LOWER-CLASS SCHOOL) 


Group 7 Group 8 Group 9 
S37 92 Sas 91 Sag 70 
Sss 86 S44 84 Ss0 86 
S39 84 S45 80 Ss 81 
S40 71 Sag 73 Ss2 71 
Sa 74 S47 69 Ssa 65 
Sao 78 Sas fall Soa 63 


Step 2. Add the scores in each:group. (Note: If you are using a caleu- 
lator, Step 2 and Step 3 can be done at the same time.) 
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Level 1 


Group | Group 2 Group 3 


74 94 87 

79 96 76 

Sums: 512 540 518 
Level 2 


Group 4 Group 5 Group 6 


70 76 70 

78 91 86 

Sums: 502 525 486 
Level 3 


Group 7 Group 8 Group 9 


92 91 70 
86 84 86 
Sums: 485 468 436 


Step 3. Square each number in the entire table (Step 1), and add 
these squared values. 


742 + 79? + +++ + 63? = 374,776 


Step 4. Add the sums of each group (Step 2) to get the grand sum 
of the entire table. 


512 + 540 + 518 + 502 + 525 + 486 + 485 + 468 + 436 = 4472 


Then, square this value, and divide by the total number of measures 
recorded in the table (see Step 1). This yields the correction term. 
4472? 19,998,784 
—— a 


= 370,347 


Step 5. Computation of the total sum of squares (SS,): Simply 
subtract the correction term (Step 4) from the sum of the squared measures 
(Step 3). 


374,776 — 370,347 = 4429 = SS, 


Step 6. Computation of the effects of levels (the overall performance 
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of students in the upper- versus middle- versus lower-class schools) : 
First, add the sums of the three levels, disregarding the other dimension, 
method of teaching (see Step 2). 


512 + 540 + 518 = 1570 = sum for the upper-class school 
502 + 525 + 486 = 1513 = sum for the middle-class school 
485 + 468 + 436 = 1389 = sum for the lower-class school 


Then, square the above sums, divide by the number of measures on which 
each of the sums was based, and add the quotients. 
1570? ee 1513? 4 1389? 6,683,390 
18 18 [Serre EtlS 


= 371,299 


Then, subtract the correction term from the above value. 
371,299 a 370,347 a 952 = SSievels 


Step 7. Computation of the treatment effects (the overall effects of 
teacher only versus teacher plus machines versus television plus machines) : 
First, add the sums of the three treatment conditions, disregarding the 
levels dimension (see Step 2). 


512 + 502 + 485 = 1499 = sum for teacher-only groups 
540 + 525 + 468 = 1533 = sum for teacher-plus-machines groups 
518 + 486 + 436 = 1440 = sum for television-plus-machines groups 


Then, square the above sums, divide by the number of measures on which 
each was based, and add the quotients. 
1499? _ 1533? re 1440? —- 6,670,690 
18 18 iS. me LS 


= 370,594 


Then, subtract the correction term from the above value. 
370,594 ee 370,347 oer 247 = SS irastients 


Step 8. Computation of the interactive effects of treatments and 
levels: First, square the sums of each of the experimental groups (Step 2), 
divide by the number of measures on which each of the sums was based, 
and then add the quotients. 


512" 540? 518” 5027. 520%, 486" 
6 6 6 6 6 6 


485? 468? 436? 2,230,238 
6 6 Roce 6 


= 371,706 


Then, subtract the correction term (Step 4), the SSieves (Step 6), and the 
SStreatments (Step 7) from the above value. 


371,706 a 370,347 — 952 — 247 = 160 = SS treatments x levels 
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Step 9. Computation of the error-term sum of squares (SSerror) : 
Simply subtract SSteves (Step 6), SStreatments (Step 7), and SStreatments x levels 
(Step 8) from SS; (Step 5). 


4429 — 952 — 247 — 160 = 3070 = SSerror 


Step 10. All computations based directly on the data have now been 
completed. Since the F ratios are ratios of mean squares, the degrees of 
freedom (df) must be computed for each of the components. 


df for SS, = the total number of measures (see Step 1) 


minus 1. 
54 —1 = 53 

df for SSieves = the number of levels used in the experiment 
minus 1. | 

3—1=2 
df for SStreatments = the number of treatment conditions 
minus 1. 

3—1=2 
df for SStreatments X levels = @f for treatments times the df for 
levels. 

2X2=4 


df for SSeror = the df for SS; minus the dfs for SSieveis, SStreatments, 
and SD irestincnts X levels: 


538 —2—2—-4=45 


Step 11. The mean squares are then computed as SS/df. 


ms (This value is not needed for the analysis. ) 
(Step 6) 952 
MSlevels = Se ~Sel76 
level 9 9 
Step 7 247 
MStreatments = eee — 58 = 123.5 


MStreatments X levels = ——————- = —_ = 40 


(Step 9) > 3070 
45°. 45 


MSerror = = 68.22 


Step 12. The several F ratios are then computed as 


MSlevels MStreatments MStreatments X levels 
MSerror MSerror MSerror 
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Step 13. Table the final analysis as follows. 


Source ss df ms F p 
Total 4429 53 — _— —_— 
Levels 952 2 476 6.98 <.005 
Treatments 247 2 123.5 1.81 n.8. 
Treatments X levels 160 4 40 .58 n.s. 
Error 3070 45 68.22 — — 


Therefore, it is concluded (see Appendix D) that while the expected 
differences in the overall arithmetic achievements of the students in the 
three schools were present, there were no differences due to the three 
methods of instruction and that the methods of instruction did not interact 
with the achievement level of the students. 


SECTION 2.5 
Treatments-by-Subjects, or Repeated-Measures, Design 


Whenever two or more different treatments are given to the same 
subjects, a very powerful statistical design can be used. This design, which 
permits analysis of repeated measures on the same individuals, is known 
by various names and is treated in the following statistics textbooks. 


Carlborg, F. W. Introduction to Statistics. Glenview, IJ.: Scott, Foresman 
and Company, 1968. Chapter 8, pp. 271-273. 

Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 14, pp. 
224-227. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 6, 
pp. 156-171. 

MeNemar, Q. Psychological Statistics, 3rd ed. New York: John Wiley & 
Sons, Inc., 1962. Chapter 16, pp. 294-303. 

Ray, W.S. Statistics in Psychological Research. New York: The Macmillan 
Company, 1962. Chapter 15, pp. 262-268." 


1 In this text, the design is treated as the ‘‘matched-group design.’’ The computations are exactly the 
same as those in this chapter. The only difference is that instead of repeated measurements on single sub- 
jects, different subjects are matched, placed in different experimental groups, and then compared to deter- 
mine the effects of the treatments. 
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Walker, H. M., and Lev, J. Statistical Inference. New York: Holt, Rinehart: 
& Winston, Inc., 1953. Chapter 9, pp. 216-226. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 4, pp. 105-124. 


Points to Consider When Using the Treatments-by-Subjects Design 


1. Each subject is tested under, and a score is entered for, each 
treatment condition. 

2. The number of subjects employed and the number of treatments 
given each subject is arbitrary. However, most experiments use 
ten to fifteen subjects, and it is rare that the effects of more than 
four or five treatments are compared. 


EXAMPLE 


In addition to analyzing the effects of successive experimental manipu- 
lations, this design is often used to indicate and evaluate the stability of 
measures over a prolonged period. This use will be illustrated in the follow- 
ing example. Assume that an experimenter wishes to know whether the 
mean scores on an intelligence test remain stable from year to year or 
whether they differ to a degree larger than could be expected by chance 
alone. To answer this question, the experimenter chooses twenty subjects, 
all twelve years old, and obtains an IQ score for each subject. Then, each 
year after that, for three years, another IQ test is given to the same twenty 
students. The IQ scores on each of these four tests are the data recorded. 

Step 1. At the end of four years, when the data have been collected, 
they are tabled as follows. 


Subject IQ—Age 12 IQ—Age 13 IQ—Age 14 IQ—Age 15 


Si 98 102 113 108 
So 104 100 105 111 
S3 126 131 128 136 
Ss 74 79 84 81 
Ss 86 85 90 88 
Se 92 92 88 95 
S7 98 96 101 103 
Ss 110 115 107 118 
So 118 122 129 120 
Sto 97 96 104 100 
Su 83 85 80 88 
Si 124 128 to 138 
Sis 133 132 130 138 
Sis 101 112 115 114 
Sis 112 108 116 114 
Si6 96 91 95 98 
Si 89 96 90 97 
Sig 95 101 99 104 
Sig 87 95 94 97 
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Step 2. Add the scores in each treatment (age level in the present 
example) to get the sum for each treatment. (Note: If you are using a 
calculator, Step 2 and Step 3 can be done at the same time.) 


Subject Age 12 Age 13 Age 14 Age 15 
Si 98 102 113 108 
S2 104 100 105 111 
Sums: 2016 2065 2095 2150 


Step 3. Square each number in the table (Step 1), and add these 
squared values together. 


98? + 104? + --- + 102? = 886,376 


Step 4. Add the sums for each treatment (Step 2) to obtain a grand 
total for the entire table. 


2016 + 2065 + 2095 + 2150 = 8326 


Step 5. Square the grand total (Step 4), and divide by the total 
number of measures recorded (see Step 1). This yields the correction term. 


8326? 
80 


= 866,528 


Step 6. Computation of the total sum of squares (SS;) : Subtract the 
correction term (Step 5) from the sum of the squared values obtained in 
Step 3. 


886,376 — 866,528 = 19,848 = SS, 


Step 7. Add the four scores recorded for each subject, and write the 
twenty sums in a column. 


Subject Age 12 Age 13 Age 14 Age 15 Sums 


S; One tii de. alld 2) 10S 421 
So if 100 OR E111 420 
cm eee ee 4 92. ee Ine 386 


Step 8. Square all the sums obtained in Step 7, and add the squares. 
4212 + 420? + +--+ 386? = 3,540,914 
Step 9. Divide the value obtained in Step 8 by the number of scores 
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that were added to get each of the sums in Step 7. (In the present example, 
4 numbers were added to get each of the sums.) 


14 
Se = 885,228 


Step 10. Computation of the sum of squares for subjects (SSsubjects) : 
Subtract the correction term (Step 5) from the value obtained in Step 9. 


885,228 — 866,528 = 18,700 = SSuubjects 
Step 11. Square each of the values obtained in Step 2, and add the 
squares. 
2016? + 2065? + 2095? + 2150? = 17,340,006 
Then, divide by the number of scores on which each sum in Step 2 was 
based. (In the present example, this would be 20.) 
17,340,006 
20 
Step 12. Computation of the sum of squares for treatments 


(SStreatments): Subtract the correction term (Step 5) from the value of 
Step 11. 


= 867,000 


867,000 — 866,528 = 472 = SStreatments 


Step 13. Computation of the error-term sum of squares (SSeror) : 
Subtract the SSsupjects (Step 10) and the SStreatments (Step 12) from the SS; 
(Step 6). 

19,848 — 18,700 — 472 = 676 = SSenor 


Step 14. All computations based directly on the data have been 
completed. However, since the test of significance (F ratio) is a ratio of 
the mean squares, these values must be computed. To do this, the degrees 
of freedom (df) must be determined for each of the components, as follows. 


df for SS; = the total number of measures (see Step 1) 
minus 1. 


80 — 1 = 79 


df for SSsubjects = the total number of subjects used in the 
experiment minus 1. 


20 —1= 19 


df for SStreatments = the total number of treatments given each 
subject minus 1. 
4—1=3 


df for SSeror = the total df minus the df for subjects and the 
df for treatments. 


79 — 19 —3 = 57 
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Step 15. The mean squares are then computed as SS/df. 


ms; (This value is not needed for analysis. ) 
MSsubjects (This is also not needed. ) 
Step 12 472 
MStreatments = Ae teD 4) SSS SS TBS 
3 3 
Step 13 676 
MSerror ( 8 ) = = 11.86 


57 57 


Step 16. Table the analysis as follows. The test of significance (F) 
is equal tO MStreatment/MSerror- 


Source Ss df ms F p 


Total 19, 848 79 _ _ _— 
Subjects 18,700 19 — — — 
Treatments 472 3 157.33 13.27 <.001 

Error 676 57 11.86 — — 


Since the F value of 13.27, with df of 3 and 57, would occur by chance 
less than once in one thousand times (see Appendix D), it is concluded 
that the IQ scores were not stable over the four-year period. 


SECTION 2.6 
Treatments-by-Treatments-by-Subjects Design 


The treatments-by-treatments-by-subjects design is a very efficient 
analysis that can be used when all treatments in a two-factor experiment 
are administered to each subject. This design is treated in the following 
textbooks. 


Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 17, pp. 
306-309. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton -Miffin Company, 1953. Chapter 10, 
pp. 237-238. 
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McNemar, Q. Psychological Statistics, 3rd ed. New York: John Wiley & 
Sons, Inc., 1962. Chapter 16, pp. 322-329. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 6, pp. 289-290. 


Points to Consider When Using the Treatments-by-Treatments- 
by-Subjects Design 


1. Each subject is tested under, and a score is entered for, each 
treatment condition within both of the factors. 

2. The number of subjects employed and the number of treatments 
given within each factor is arbitrary. However, most experiments 
use ten to fifteen subjects, and it is rare that the effects of more 
than four or five treatments within either or both of the factors 
are compared. 


EXAMPLE 


Consider a memorization experiment where the experimenter wants 
to study the relationship between short-term and long-term retention on 
the one hand and easy and difficult items on the other. The experimenter 
has every subject learn both easy and difficult items, and he measures the 
retention of these items over short and long periods of time. In this experi- 
ment, the experimenter is not interested in analyzing performance over 
several trials. Therefore, he will consider only the total number of correct 
responses. (Note: If he were also to consider trials, this would add another 
dimension and make this a treatments-by-treatments-by-treatments-by- 
subjects design.) The scores recorded for each subject are the subject’s 
total number of correct responses on the easy and difficult items when he 
is tested after a short and after a long period of time. 

Step 1. Table the data as follows. Remember, each subject performs 
under each treatment condition within both factors. 


Short-Term Retention Long-Term Retention 
Subject Easy Items Difficult Items Easy Items Difficult Items 
St 83 100 75 40 
So 100 83 71 41 
S3 100 100 50 43 
S4 89 92 74 47 
Ss 100 90 83 62 
Se 100 100 100 70 
S7 92 92 72 44 
Ss 100 89 83 62 
So 50 54 33 38 


Sto 100 100 72 50 
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Step 2. Add the scores in each treatment for both factors. (Note: If 
you are using a calculator, Step 2 and Step 3 can be done at the same time.) 


Subject STR-Hasy STR-Diffcult LTR-Easy LTR -Difficult 


Sy 83 100 75 40 
So 100 83 a 41 
Sums: 914 900 713 407 


Step 3. Square each number in the table (Step 1), and add the 
squares. 


83? + 100? + +--+ + 50? = 248,212 


Step 4. Add the sums for each treatment for both factors (Step 2) 
to obtain a grand total for the entire table. 


914 + 900 + 713 + 497 = 3024 


Step 5. Square the grand total of Step 4, and divide by the total 
number of measures recorded in Step 1 (40 in this example). This yields 
the correction term. 


30242 9,144,576 
40 te 40 


= 228,614.4 
Step 6. Subtract the correction term (Step 5) from the sum of the 
squares obtained in Step 3. 
248,212 — 228,614.4 = 19,597.6 = SS, 


Step 7. Add all the scores recorded for each subject in Step 1, and 
write these sums in a column. 


Short-Term Retention Long-Term Retention 


Subject Easy Items Difficult Items Easy Items Difficult Items Sums 


Si ge 100 af ne 40 208 
So 100 Ses 83 + ies ee 41 205 
Bin 1000. “4 100 ue 59 ie ts 50 322 


Step 8. Square all the sums obtained in Step 7, and add the squares. 
2982 + 2952 + +--+ + 322? = 937,872 
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Step 9. Divide the value obtained in Step 8 by the number of scores 
that were added to get each of the sums in Step 7 (4 scores were added in 
this example). 


2 
sae = 234,468 


Step 10. Subtract the correction term of Step 5 from the value of 
Step 9. 


234,468 — 228,614.4 = 5853.6 = SScubjects 


Step 11. Computation of the sum of squares for the first factor 
(the differential effects of STR versus LTR—SSvretention) : First, add the 
sums of the STR and the LTR treatments (Step 2), disregarding the 
difficulty-of-items dimension. 


914 + 900 = 1814 = sum of the STR treatment 
713 + 497 = 1210 = sum of the LTR treatment 


Then, square the above sums, divide by the number of measures on which 
each sum was based (20 in this example), and add the quotients. 
1814? 4 1210? 4,754,696 
20 7 aim 3 


= 237,734.8 


Then, subtract the correction term (Step 5) from the above value. 
237,734.8 =~ 228,614.4 = 9120.4 = SSicuncon 


Step 12. Computation of the effects of the second factor (the effects 
of easy versus difficult items—SSuiticuty) : First, sum the scores on the easy 
items and on the difficult items (Step 2), disregarding the retention 
dimension. 


914 + 713 = 1627 = sum of the easy items 
900 + 497 = 1397 = sum of the difficult items 


Then, square the above sums, divide by the number of measures on which 
each sum was based (20 in this example), and add the quotients. 
1627? 4 1397? 4,598,738 
20 oie TUG 


= 229,936.9 


Then, subtract the correction term (Step 5) from the above value. 
229,936.9 — 228,614.4 = 1322.5 = SSaisicutty 


Step 13. Computation of the interactive effects of the first and second 
factors (SSretention x difficulty) : First, square the sums of each of the experimental 
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treatments «Step 2), divide by the number of measures on which each 
sum was based (10 in this example), and add the quotients. 
wie MP . Wi8* 497 — 2 A007 74 
(OAT iG lon Pe Wier a0 


= 240,077.4 


Then, subtract the correction term (Step 5), the sum of squares for re- 
tention (Step 11), and the sum of squares for difficulty (Step 12) from 
the above value. 


240,077.4 — 228,614.4 == 9120.4 =e e220 =S 1020.1 == SSretention X difficulty 


Step 14. Computation of the error term for retention (SSerror for retention) : 
This requires that the data be retabled as follows. For each subject, add the 
number of correct responses made to the tests of STR and those of LTR 
(disregarding the difficulty-of-items dimension). 


Subject STR LTR 
Sy 183 (83 + 100) 115 (75 + 40) 
So 183 (100 + 83) 112 (71 + 41) 
Ss 200 93 
S4 181 121 
Ss 190 145 
Se 200 170 
S7 184 116 
Ss 189 145 
So 104 71 
Sto 200 122 


Then, square all the sums in the above table, and add the squares. 
183? + 183? + +++ + 122? = 489,622 


Then, divide the above value by the number of scores added to get each 
of the sums entered in the table in Step 14 (2 in this example). 


489,622 Soa 
Zz 
Then, from this value, subtract the correction term (Step 5), the sum of 
squares for subjects (Step 10), and the sum of squares for retention 
(Step 11). 
244,811 — 228,614.4 — 5853.6 — 9120.4 = 1222.6 = SSerror for retention 
Step 15. Computation of the error term for item difficulty 
(SSerror for difficulty) : Again, the data must first be retabled. For each subject, 


add the number of correct response$’ made on the easy and on the difficult 
items (disregarding the retention conditions). 
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Subject Easy Difficult 
Si 158 (83 + 75) 140 (100 + 40) 
S2 171 (100 + 71) 124 (83 + 41) 
S3 150 143 
S4 163 139 
Ss 183 152 
Se 200 170 
Sy 164 136 
Ss 183 151 
So 83 92 
Sio 172 150 


Then, square all the sums in the above table, and add the squares. 

158? + 171? + +--+ + 150? = 472,632 
Then divide this value by the number of scores added to get each of the 
sums in the above table (2 in this example). 


472,632 
5010 


Then, from this value, subtract the correction term (Step 5), the sum of 
squares for subjects (Step 10), and the sum of squares for difficulty 
(Step 12). 


236,316 ad 228,614.4 a 5853.6 ae 132255 Sy 52525 a Serr for difficulty 


Step 16. Computation of the error term for retention-by-difficulty 
interaction (SSerror for retention X difficulty) : From the total sum of squares (Step 6), 
subtract the sum of squares for subjects (Step 10), sum of squares for 
retention (Step 11), sum of squares for difficulty (Step 12), sum of squares 
for difficulty by retention (Step 13), error for retention (Step 14), and 
error for difficulty (Step 15). 


19,597.6 — 5853.6 — 9120.4 — 1322.5 — 1020.1 — 1222.6 — 525.5 


= 532.9 = SSerror for retention X difficulty 
Step 17. All computations based directly on the data have been 
completed. However, since the test of significance (F ratio) is a ratio of 
mean squares, the degrees of freedom must be determined for each of the 
components. 


df for SS, = the total number of measures recorded in Step 1 
minus 1. 
40 — 1 = 39 


df for SSsubjects = the number of subjects used in the experi- 
ment minus 1. 
10—1=9 
df for SSretention = the number of retention conditions minus 1. 
Dinara) Bee | 


Step 18. 


Step 19. 
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df for SSerror for retention = the df for SSsubjects times the df for 


retention: 


9X1=9 
df for SSuisicuty = the number of difficulty conditions minus 1. 
2—l1=1 


Af for SSerror for difficulty = the df for SSsubjects times the df for 
SSaiticulty- 
9xX1=9 


df for SSretention me difficulty = the df for SSretention times the df for 
SSuiticuity. 
1X1l=1 


df for SScror for retention X difficulty = the df for subjesta times the 
df for SSretention times the df for SSaiticulty- 


9xX1xX1=9 
The desired mean squares are then computed as SS/df. 


(Step 11) 9120.4 


MSretention = = 9120.4 
1 il 
Step 12 132255 
MSdifficulty = whi dae = = 1322.5 
1 il 
Step 13 1020.1 
MSdifficulty X retention — ( P ) — = 1020.1 
1 1 
MSretention error oa uP » = ee = 135.844 
9 9 
Step 15 SPAT 
MSdifficulty error = ( = ) = = 58.389 
Step 16 532.9 
MSdifficulty X retention error = ( ; ) = 9 = 59.211 


Table the analysis as follows. The tests of significance 


(F ratios) are computed as 


MSretention MSdifficulty 


MSerror for retention MSerror for difficulty 


MSdifficulty X retention 


MSerror for difficulty X retention 
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Source ss df ms F p 
Total 19, 597.6 39 — — — 
Subjects 5853.6 9 — _— 
Retention 9120.4 1 9120.4 67.14 <.001 
Difficulty 1322.5 1 1322.5 22.65 <.005 
Difficulty X retention 1020.1 1 1020.1 17.23 <.005 
Error retention 1222.6 9 135.84 — 
Error difficulty 525.5 9 58.39 — —= 
Error retention X difficulty 532.9 9 59.21 — — 


Therefore, it is concluded (see Appendix D) that: 


1. The length of the retention interval had a significant effect on 
the amount retained. 

2. The difficulty of the learned material significantly affected the 
amount retained. 

3. The effects of difficulty of material and retention interval inter- 
acted to a significant degree. 


SECTION 2.7 


Two-Factor Mixed Design: Repeated Measures on 


One Factor 


This two-factor mixed design is basically a combination of the com- 
pletely randomized design and the treatments-by-subjects design. Not 
only does this design permit comparison of the differences in the overall 
performance of the subjects in the several experimental groups, but it also 
permits evaluation of the changes in performance shown by the subjects 
during the experimental session. It is known by various names and is 
discussed in the following textbooks. 


Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 14, pp. 
227-232. 


2.7 Two-Factor Mixed Design / 55 


Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 13, 
pp. 266-273. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 7, pp. 302-312. 


Points to Consider When Using the Two-Factor Mixed Design 


1. If trials or observations are blocked, each block is treated as one 
score. 

2. Although it is not necessary, it is usually best to have an equal 
number of subjects in each experimental group. 

3. The number of experimental groups compared, the number of 
subjects per group, and the number of trials or observations 
(scores) recorded for each subject is arbitrary. However, it is 
rare that more than four or five experimental groups are compared 
in one experiment and that more than five or six scores are entered 
and analyzed for each subject. In most experiments, ten to fifteen 
subjects are assigned to each experimental group. 


EXAMPLE 


Assume that an experimenter wishes to determine the effects of 
meaningfulness of material on rate of learning. He randomly assigns sub- 
jects to three groups, one of which must learn a low-meaningful list of 
nonsense syllables, the second a medium-meaningful list, and the third 
a high-meaningful list. All subjects are given fifteen trials, and the number 
of correct responses per trial is recorded. To simplify his analysis, he 
blocks the number of correct responses into three blocks of five trials each. 
Thus, the scores used in the analysis represent the number of correct 
responses for each successive block of five trials. 

Step 1. After the experiment has been conducted, table the data as 
follows. 


Group 1 (Low-Meaningful Material) 
Subject Trial Block 1 Trial Block 2 Trial Block 3 


Sr 3 3 4 
Se 3 4 4 
S3 1 3 4 
Ss i 2 3 
Ss 2 3 5 
Se 4 5 6 
S7 4 5 6 
Ss 1 4 5 
So 1 4 5 
S10 2 3 3 
Su 2 Z 4 
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Group 2 (Medium-Meaningful Material) 


Sie 2 3 6 
Siz 1 4 5 
Sis 3 6 ff 
Sis 2 4 6 
Sie 1 2 3 
Si 4 5 5 
Sis 1 3 4 
Sis 1 2 4 
Soo 2 3 4 
Sa 3 5 6 
Soo 4 6 a 


Group 3 (High-Meaningful Material) 


x 
PRE WN Ewe Rw Dd 
OMOoankI Ii 3s 
— me 
NN MRAWNWNY HAW OO 


Step 2. Add the scores in each group for each trial block (hereafter, 
referred to simply as “‘trials’’). 


Group 1 


Subject Trial 1 Trial 2 Trial 3 


Si 3 33 4 

Se 3 4 4 

Sums: 24 38 49 
Group 2 

Si 2 3 6 


Sums: 24 43 57 
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Group 3 
Sos 2 4 8 
Soa 3 6 3 
Sums: 25 65 70 


Step 3. Obtain the sum for each group by adding the sums of the 
individual trials (Step 2). 
24 + 38 + 49 = 111 = sum of Group 1 
24 + 43 + 57 = 124 = sum of Group 2 
25 + 65 + 70 = 160 = sum of Group 3 


Step 4. Add the scores for each subject in each group. (Note: If you 
are using a calculator, Step 5 can be done at the same time as Step 4.) 


Group 1 
Subject Trial 1 Trial 2 Trial 3 Sums 
Si 3 + 3 + 4 10 
Se 3 = 4 + 4 il 
ee ee 8 


Step 5. Square each score in the entire table (Step 1), and add these 
squared values to get a grand sum of the squared values. 


32 + 32+ +--+ 7? = 2043 
Step 6. Add the group totals (Step 3) to get the grand sum of the 


entire table. 
111 + 124 + 160 = 395 
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Step 7. Square the grand sum (Step 6), and divide it by the total 
number of measures in the entire table—i.e., the number of subjects times 
the number of measures per subject (see Step 1). (In the present example, 


this would be 33 X 3 = 99.) The resultant value is the correction term. 
ie 
395’ 156,025 


ae 99 99 
~ 


= 1576} 


Step 8. Computation of the total sum of squares (SS;): Simply 
subtract the correction term (Step 7) from the sum of the squared scores 
(Step 5). 

2043 — 1576 = 467 = SS: 


Between-Subjects Effects (Steps 9-11) 


Step 9. Computation of the between-subjects sum of squares (SS) : 
First, square the sum of each subject’s scores (Step 4), and add these 
squared valués. 

10? + 112+ --- + 20? = 5271 
wes divide this value by the neues. of trials given each subj. ect. 


“5271 = 1789 


Then, subtract the correction term from the above value. 
1757 — 1576 = 181 = SS, 

Step 10. Computation of the effects of the experimental conditions 
on overall performance (SS,): (In the present example, these are the 
meaningfulness effects.) First, square the sum for each experimental group 
(Step 3), and divide these values by the number of measures in each experi- 
mental group. (In the present example, this would be 11 subjects X 3 trials 
per subject, or 33.) Then, add these quotients. 

a hE 124 160? 3,297 


ay : = = 1615 
} > 33° 33.7 33 33 


Then, subtract the correction term from the above value. 
1615 — 1576 = 39 = S§, 


Step 11. Computation of the between-subjects error term (error) : 
Simply subtract the SS, (Step 10) from the SS; (Step 9). 


181 — 39 = 142 = error, 


_Within- Subjects Effects (Steps 12-15) 


ene RE ct SN A 


Step 12. Computation of the within-subjects sum of squares (SS,) : 
Simply subtract the SS, (Step 9) from the SS; (Step 8). 


467 — 181 = 286 = SS, 
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Step 13. Computation of the sum_of. squares for, trials- (SSi-) : First, 
add the sums of Trial 1 (Step 2) for all experimental groups77”"~ 
24 + 24 + 25 = 73 = sum for Trial 1 
Do the same for Trial 2 and Trial 3. 


38 + 43 + 65 = 146 = sum for Trial 2 
49 + 57+ 70 = 176 = sum for Trial 3 


Then, square each of these sums, and divide the products by the number 
of measures on which each sum was based. 
for 1467 “EGG” 57,621 
aed) ange Sah ie ieg3 


= 1746 


Then, subtract the correction term from the above value. 
1746 — 1576 = 170 = SSi- 


Step 14. Computation of the sum of squares for the trials-by-con- 
ditions interaction (SSt x) : First, square the sums of each trial in each of 


the experimental groups (Step 2), divide by the number of measures on 
which each sum was based, and add these quotients. 
a i 
11 11 11 11 11 11 
257 65? 70? ~=—-:19,845 


. ap ot i 11 


= 1804 


Then, from this value, subtract the correction term (Step 7), SS. (Step 10), 
and SS;, (Step 13). 


1804 — 1576 — 39 — 170 = 19 = SSirxe 
Step 15. Computation of the within-subjects « error term (errory): 
Simply subtract SS, (Step 13) and SS. (Step 14) from the SS, 
(Step 12). 
286 — 170 — 19 = 97 = error, 
Step 16. All computations based directly on the data have been 
completed : { 


- SS = 467 (Step 8) 
~ SS, = 181 (Step 9) 
- SS. = 39 (Step 10) 


- SSeror, = 142 (Step 11) 
~ SS, = 286 (Step 12) 
- SS: © = 170 (Step 13) 
> SStr x ¢ = 19 (Step 14) 
~ SSenor, = 97 (Step 15) 
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However, since the tests of significance (F-tests) are ratios of mean squares, 
we must compute these values. To do this, the degrees of freedom (df) 
for each of the components must be determined, as follows. 


Step 17. 


df for SS, = the total number of measures recorded minus 1. 


CO 99 — 1 = 98 
df for SS, = the total number of subjects minus 1. 
10 633 -—1 = 32 
df for SS, = the total number of experimental groups minus 1. 
a 3-—l1=2 
df for SSeror, = the df for SS, minus the df for SS,. 
32 — 2 = 30 
df for SS, = the df for SS; minus the df for SS». 
98 — 32 = 66 ; 
df for SSt; = the number of trials given each subject minus 1. 
te 3—-1=2 
df for SSux¢ = the df for SS, times the df for SS.. 
i 2X2=4 


df for SSeror, = the df for SS minus the df for SSi; minus 
the df for SS x e. 


66 —2—4= 60 


The mean squares are then computed as SS/df. 
mst (This value is not needed.) 
MSp (This value is not needed.) 

_ (Step 10) 39 
MSc = 9 a a 19.5 
_ (Step 11) _ 142 
MSerror, = 30 = 30 = 4.73 
MSw (This value is not needed.) 
_ (Step 13) — 170 
Mir = 9 = Tae: 85 
Step 14 19 
nee ee eee 


Step 15 97 
MSerror, = four =a OZ 
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Step 18. Table the final analysis as follows. The tests of significance 
(F-tests) are equal to 


MSe MStr MStr x 
MSerror, MSerror,, MSerror,, 
Source ss df ms F p 
Total 467 98 — — — 
Between subjects 181 32 — - — 
Conditions 39 2 19.50 4.12 <.05 
Error, 142 30 4.73 _— — 
Within subjects 286 66 — — — 
Trials 170 2 85.00 52.46 <.001 
Trials X conditions 19 4 4.75 2.93 < 05 
Error, 97 60 1.62 — — 


Hence, it is concluded (see Appendix D) that: 

1. Meaningfulness of material significantly affected the overall 
amount learned. 

2. Subjects learned as a function of practice (trials). 

3. The groups of subjects learned at different rates. 


SECTION 2.8 


Three-Factor Mixed Design: Repeated Measures on 


One Factor 


The three-factor mixed design is basically a combination of the factorial 
design and the treatments-by-subjects design. Not only does this design 
permit examination of the effects of two factors in combination with each 
other, but it also permits examination of performance variations shown by 
the subjects during the experimental session. It is known by several names 
and is discussed in the following textbooks. 
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Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 14, pp. 
233-239. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 13, 
pp. 281-284. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 7, pp. 337-344. 


Points to Consider When Using the Three-Factor Mixed Design 


1. As in the other designs, if trials are blocked, each block is treated 
as one score. 

2. It is usually best to have an equal number of subjects in each of 
the experimental groups. If equality cannot be obtained, the 
number of subjects in each group should be proportional. In 
most experiments, ten to fifteen subjects are assigned per group. 

3. The number of experimental groups within each factor is arbitrary. 
However, it is rare that more than four or five groups are included 
in either of the two factors. Similarly, it is rare that more than 
five or six scores are entered and analyzed for each of the subjects. 


EXAMPLE 


Assume that an experimenter wishes to determine the effects of high 
versus low self-esteem in combination with failure versus nonfailure in- 
structions on the learning of verbal material. Subjects are randomly as- 
signed to one of four groups. The subjects in Group 1 (high self-esteem /fail- 
ure) are initially told that they are likely to perform the task very well. 
After a short practice period, they are then told that they actually per- 
formed very poorly and must try harder on the next task, which “counts.” 
Group 2 subjects (high self-esteem/nonfailure) are also initially told that 
they are likely to perform well. After the practice period, they are told 
that they did do very well but should not relax their efforts since the next 
task is the one that ‘‘counts.’’ Group 3 subjects (low self-esteem/failure) 
are initially told that their performance is likely to be very low. Following 
the practice period, they are told that they did poorly, as expected, and 
should try harder on the next task. Group 4 subjects (low self-esteem/non- 
failure) are also told that their performance is likely to be very low. Fol- 
lowing the practice period, they are told that they actually did very well 
and should try to do as well on the following task. 

Following these manipulations of self-esteem and failure/nonfailure, 
the subjects in all groups are given twenty trials to learn a list of low- 
meaningful nonsense syllables. For analysis purposes, the experimenter 
blocks the scores for the twenty trials into four blocks of five trials each. 
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The number of correct responses within each of these blocks of five trials 
is the score recorded. 


Step 1. After the experiment has been conducted, table the data as 
follows. 


Group 1 (High Self-Esteem /Failure) 


Subject Trial Block 1 Trial Block 2 Trial Block 3 Trial Block 4 


Sy 4 6 i 9 
So 6 7 9 11 
S3 5 8 10 13 
S4 3 + 6 9 
Ss 4 6 9 10 
Ss 5 5 6 8 
S7 7 8 9 12 
Group 2 (High Self-Esteem /Nonfailure) 
Ss 5 8 9 12 
So 3 5 10 14 
Sto 7 10 12 13 
Su 5 8 11 15 
Si 4 9 13 15 
Sis 3 5 9 12 
Su 6 7 8 11 
Group 3 (Low Self-Esteem /Failure ) 
Sis 3 4 + 5 
Si6 5 6 8 9 
Siz 5 6 6 8 
Sis 5 6 i 8 
Sig 3 4 4 5 
Soo 7 fi 8 7 
Sa 6 8 8 8 
Group 4 (Low Self-Esteem/Nonfailure ) 
Soo 4 8 10 14 
So3 5 10 14 18 
Sos 3 7h 12 18 
Sos 5 8 11 17 
S26 6 11 15 19 
So7 6 8 10 15 
Sos 5 11 17 20 


Step 2. Add the scores in each group for each trial block (hereafter 
referred to only as ‘“‘trials’’). 
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Group 1 
Subject Trial 1 Trial 2 Trial 3 Trial 4 


Sy 4 6 7 9 

So 6 if 9 11 

Sums: 34 44 56 72 
Group 2 

Ss 5 8 9 12 

Sg 3 5 10 14 

Sums: 33 52 72 92 
Group 3 

Sis 3 4 4 5 

Si6 5 6 8 9 

Sums: 34 41 45 50 
Group 4 

Soo 4 8 10 14 

So3 5 10 14 18 

Sums: 34 63 89 121 


Step 3. Obtain the sum for each group by adding the sums of the 
individual trials. 


34 + 44+ 56+ 72 = 206 = sum for Group 1 
33 + 52+ 72+ 92 = 249 = sum for Group 2 
34 + 41 +45-+ 50 = 170 = sum for Group 3 
34 + 63 + 89 + 121 = 307 = sum for Group 4 


Step 4. Add the scores for each subject in each group. (Note: If you 
are using a calculator, Step 5 can be done at the same time as Step 4.) 


Group 1 
Subject AdiwEM Trial 2 Trial 3 Trial 4 Sums 
Si 4 oF 6 aie 7 ae 9 26 


So 6 + 7 a 9 a5 11 33 


Sy Tityy kvem Sivbalee a: Ok Sieane 36 
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Group 2 
Ss & + 8 + 9 + 12 34 
Ss 3 + 5 4- 10 + 14 32 
Sis 6 a Zi + 8 oe 11 32 
Group 3 
Sis 3) 4- 4 SF 4 ae o 16 
Sig 5 + 6 +. 8 + 9 28 
So 6 + 8 + 8 + 8 30 
Group 4 
Soe 4 + 8 oe 10 + 14 36 
So3 5 10 = 14 + 18 47 
Ra BY en sank? | geal i7 20 53 


Step 5. Square each score in the entire table (Step 1), and add these 
squared values to get the grand sum of the squared numbers. 


42+ 6 4+ +++ + 20? = 9412 


Step 6. Add the group totals (Step 3) to get the grand sum of the 
entire table. 


206 + 249 + 170 + 307 = 932 


Step 7. Square the grand sum, and divide it by the total number of 
measures in the entire table—i.e., the number of subjects times the number 
of measures per subject (see Step 1). The value obtained is the correction 
term. 

932? 


aie ih) 
112 


Step 8. Computation of the total sum of squares (SS,): Simply 
subtract the correction term (Step 7) from the sum of squares (Step 5). 


9412 — 7755 = 1657 = SS; 


Between-Subjects Effects (Steps 9-13) 


Step 9. Computation of the between-subjects sum of squares (SSp) : 
First, square the sum of each subject’s scores (Step 4), and add these 
squared values. 


267 + 33? + +++ + 53? = 33,324 


66 / Part 2 Analysis of Variance 


Then, divide this value by the number of trials given to each subject. 


33,324 


Then, subtract the correction term (Step 7) from the above value. 
8331 — 7755 = 576 = SS, 


Step 10. Computation of the effects of the first experimental con- 
dition on overall performance (the overall effects of high versus low 
self-esteem—SSwsteem) : First, sum the scores of the two self-esteem groups 
(Step 3), disregarding the failure/nonfailure instructions. 


206 = sum for Group 1 (high self-esteem /failure) 
+249 = sum for Group 2 (high self-esteem/nonfailure) 


455 = sum for all high self-esteem subjects 


170 = sum for Group 3 (low self-esteem/failure) 
+307 = sum for Group 4 (low self-esteem /nonfailure) 


477 = sum for all low self-esteem subjects 


Then, square the sums of the two experimental conditions obtained above, 
and divide each product by the number of measures added to get each of 
the sums. (In the present example, the divisor is 56 in both cases: 7 subjects 
per group X 2 groups X 4 trials per subject.) Then, add the quotients. 


455? ai 477? 
56 56 


= 7759 


Then, subtract the correction term (Step 7) from the above value. 
7759 iia 1755 =4= SSesteem 


Step 11. Computation of the effects of the second experimental 
condition on overall performance (the effects of failure versus nonfailure— 
SShaiture) : First, sum the scores of the two failure/nonfailure groups (Step 3), 
disregarding the high versus low self-esteem. 


206 = sum for Group 1 (high self-esteem/failure) 
+170 = sum for Group 3 (low self-esteem/failure) 


376 = sum for all subjects who ‘failed’ 
249 = sum for Group 2 (high self-esteem/nonfailure) 
+307 = sum for Group 4 (low self-esteem /nonfailure) 


556 = sum for all subjects who did not “‘fail’’ 


Then, square the sums of these two experimental conditions, and divide 
the squared values by the number of measures added to get each sum. 
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(Here, each sum was obtained by adding 56 scores.) Then, add the quo- 
tients. 


376° 556? 
56 rb 56 


= 8045 


Then, subtract the correction term (Step 7) from the above value. 
8045 — 7755 = 290 = SSniture 


Step 12. Computation of the interactive effects of the two experi- 
mental conditions: (In this example, we are attempting to determine 
whether the effects of failure or nonfailure instructions on learning are 
influenced by the self-esteem of the subject—SSesteem x failure.) First, square 
the sum of each of the experimental groups (Step 3); then, divide these 
products by the number of measures added to get each. (Here, 28 scores 
were added to get each.) Then add the quotients. 


2062 249? ~ ~=6170? : 307? 
28 28 28 28 


= 8128 


Then, from this value, subtract the correction term (Step 7), the SSesteem 
(Step 10), and the SSriture (Step 11). 


8128 aes 7755 bane 4 a 290 = 79 = SSectsam X failure 


Step 13. Computation of the between-subjects error term (errorp) : 
Simply subtract the SSesteem (Step 10), SSpiture (Step 11), and SSesteem x failure 
(Step 12) from the SS, (Step 9). 


576 — 4 — 290 — 79 = 203 = error, 
Within-Subjects Effects (Steps 14—19) 
Step 14. Computation of the within-subjects sum of squares (SS,): 
Simply subtract the SS, (Step 9) from the SS; (Step 8). 
1657 — 576 = 1081 = SS, 


Step 15. Computation of the sum of squares for trials (SStrials) : First, 
add the sums of each trial for all experimental groups (Step 2). 


344+ 33+ 34+ 34 = 135 = sum of Trial 1 
44+ 52+ 41+ 63 = 200 = sum of Trial 2 
56+ 72+ 45+ 89 = 262 = sum of Trial 3 
72 + 92 + 50 + 121 = 335 = sum of Trial 4 


Then, square each of these sums, divide each square by the number of 
measures on which that sum was based, and add the quotients. 


2 2 2 2 
135° 200 262 “e 335 — 3530 
28 28 28 28 
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Then, subtract the correction term (Step 7) from the above value. 
8539 — 7755 = 784 = SStrials 


Step 16. Computation of the sum of squares for the trials-by- 
first-condition interaction (here, the trials-by-self-esteem interaction— 
SStrials x esteem): First, sum the scores of the two self-esteem groups on each 
trial (Step 2), disregarding the failure/nonfailure instructions. 


Trial 1 Trial 2 Trial 3 Trial 4 


Group 1 (high self-esteem/failure) 34 44 56 mais 
Group 2 (high self-esteem/nonfailure) 33 52 72 92 
Sums of all high-self-esteem Ss = 67 96 128 164 
Group 3 (low self-esteem/failure) 34 41 45 50 
Group 4 (low self-esteem/nonfailure) 34 63 89 121 
Sums of all low-self-esteem Ss = 68 104 134 171 


Then, square the sums of each trial, divide by the number of measures 
on which each of the sums was based, and add the quotients together. 


67? 96 128° 164? 68°, 104? 134 171? ee 
140 14 14 14 14 14 14 Idea 


Then, from this value, subtract the correction term (Step 7), SSesteem 
(Step 10), and SStiais (Step 15). 


8544 — 7755 — 4 — 784 = 1 = SSurisis x esteem 


Step 17. Computation of the sum of squares for the trials-by-second- 
condition interaction (here, the trials-by-failure/nonfailure interaction— 
SStriate x failure) : First, sum the scores of the two failure/nonfailure groups on 
each trial (Step 2), disregarding high and low self-esteem. 


Trial 1 Trial 2 Trial 3 Trial 4 


Group 1 (high self-esteem/failure) 34 44 56 72 
Group 3 (low self-esteem/failure) 34 41 45 50 

Sums for all ‘failure’ Ss = 68 85 101 122 
Group 2 (high self-esteem/nonfailure) 33 52 72 92 
Group 4 (low self-esteem/nonfailure) 34 63 89 121 


Sums for all ‘“nonfailure’”’ Ss = 67 115 161 213 
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Then, square the sums of each trial, divide by the number of measures on 
which each of the sums was based, and ddd the quotients together. 


GSC come ll? Iza Gia lloeen aole= HoT a" “J 
14 14 14 14 14 14 14 14 


Then, from this value, subtract the correction term (Step 7), SStaiture 
(Step 11), and SSrriais (Step 15). 


8996 — 7755 — 290 — 784 = 167 = SStriats x failure 


Step 18. Computation of the sum of squares for the trials-by-first- 
condition-by-second-condition interaction (here, the interaction of trials 
by self-esteem by failure/nonfailure—SSrais x esteem X failure): First, square 
the sums of each trial in each of the experimental groups (Step 2). Divide 
each squared value by the number of measures on which each sum was 
based, and then add the quotients together. 


ee 
7 ecu io ver 


50? 34? 121? 63,902 


eee — — eee = 9129 
seks eae Senn a a ; 


Then, from this value, subtract the correction term (Step 7), SSesteem 
(Step 10), SSniture (Step as Sarena failure (Step 12), SSirials (Step 15), 
aisle 3 etlonn (Step 16), and SStrials x failure (Step Le); 


9129 — 7755 — 4 — 290 — 79 — 784 — 1 — 167 
= 49 = SSirials x esteem X failure 


Step 19. Computation of the within-subjects error term (error): 
Subtract SStriais (Step 159% SStrials x esteem (Step 16), SSrtrials x failure (Step AZ); 


1081 — 784 — 1 — 167 — 49 = 80 = error, 


Step 20. All computations have now been completed: 


SS. = 1657 (Step 8) 
SS, = 576 (Step 9) 
SSesteont =4 (Step 10) 
SStaiture = 290 (Step 11) 
SSestcem X failure = 79 (Step 12) 
SSerron, = 203 (Step 13) 
SS, = 1081 (Step 14) 
SStrials = 784 (Step 15) 


SStriats X esteem 1 (Step 16) 
SStrials x failure 167 (Step 17) 
SStrials X esteem X failure = 49 (Step 18) 
SSerror w = 80 (Step 19) 
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However, since the tests of significance (F-tests) are ratios of mean 
squares, we must compute these values. To do this, the degrees of freedom 
(df) for each of the components must be determined, as follows. 


df for SS; = the total number of measures recorded minus 1. 
112 —1=111 
df for SSp = the total number of subjects minus 1. 
28 —1=27 
df for SSestem = the number of self-esteem groups minus 1. 
2—-1=1 


df for SStaiture = the number of failure/nonfailure groups 
minus 1. 
2-l1=1 


df for SScsteem x failure = the df for esteem times the df for 
failure/nonfailure. 


1x1l=1 


df for SSeron, = the df for SS, minus the dfs for esteem, 
failure, and esteem by failure. 


27-—1-—1-—1=24 
df for SS, = the df for the SS; minus the df for SS». 
111 — 27 = 84 

df for SStiais = the number of trials given each subject minus 1. 
4—1=3 

df for SStriais x esteem = the df for SStriats times the df for SSesteem- 
3xX1=3 

df for SStriats x failure = the df for SStiais times the df for SSpiture- 
3xX1=3 


Gf for SSwisis  exteom X failure = the df for SStiats times the df for 
SSniture times the df for Saree 


3xX1xX1=3 


df for SSeror, = the df for SS, minus the dfs for SStiais, 
SSurials x esteem, SStrials x failure, and SStrials x esteem  failure- 


84—3-—3-—3-—3= 72 


Step 21. 


Ms¢ 
MSp 


MSesteem 


MSfailure 


MSesteem X failure 


MSerror, 


MSw 


MStrials 


MStrials X esteem 


MStrials x failure 


MStrials X esteem X failure = 


MSerror,, 
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The mean squares are then computed as SS/df. 


(This value is not needed.) 
(This value is not needed.) 


_ (Step10) _4_, 
Poa aad ot 
Step 11 290 
ssl) asl EOS 
1 i] 
— (Step 12). 798. 
; mr 79 
(Step 13) my 203 feeae 
24 24 
(This value is not needed. ) 
(Step 15) 784 
——— = — = 231. 
3 3 33 
(Step 16) 1 _ 
3 Tatts 33 
(Step 17) 167 
St ial ee eros 
3 3 
(Step 18) ie Ne pee 
3 3 
(Step 19) My 80 ee 
72 72 


Step 22. Table the final analysis as follows. The tests of significance 
(F ratios) are equal to the mean squares of the experimental conditions 
divided by their appropriate error terms. 


Source 


Total 
Between subjects 
High/low esteem 
Failure/nonfailure 
Esteem X failure 
Error, 
Within subjects 
Trials 
Trials X esteem 
Trials X failure 
Trials X esteem X failure 
Error w 


df ms F p 
111 — —— = 
27 = — 
1 4 <1 = 
1 290 34.27 <.001 
1 79 9.34 <.001 
24 8.46 — — 
84 — — == 
3 261.33 235.43 <.001 
3 33 <<] = 
3 55.67 50.15 <.001 
3 16.33 14.71 <.001 
72 ei a = 
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Hence, it is concluded (see Appendix D) that: 

1. The type of instructions given the subjects (failure versus non- 
failure) affects the overall performance level. 

2. The effect of the instructions, however, is dependent upon the 
self-esteem of the subjects. 

3. All subjects did learn as a function of practice (trials). 

4. The rate of learning is dependent upon the type of instructions 
given. 

5. The effect of the instructions on rate of learning is dependent 
upon the self-esteem level of the subjects. 


SECTION 2.9 


Three-Factor Mixed Design: Repeated Measures on 


Two Factors 


This design is basically a combination of the treatments-by-treatments- 
by-subjects design and the completely randomized design. Instead of only 
one group of subjects receiving all the treatment conditions (as in the 
treatments-by-treatments-by-subjects design), two or more experimental 
groups are compared (as in the completely randomized design). Thus, this 
design permits the comparison of several groups’ performance and the 
evaluation of the variations in performance shown by the subjects under 
all treatment conditions within both factors presented. It is discussed in 
the following textbooks. 


Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 17, pp. 
309-311. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 13, 
pp. 292-297. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 7, pp. 319-337. 
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Points to Consider When Using the Three-Factor Mixed Design 


1. Each subject in a particular experimental group is tested under 
each treatment condition within both of the factors. 

2. The number of subjects used in each experimental group is arbi- 
trary. Again, while it is not necessary, it is best to have an equal 
number of subjects in each group. In most experiments, ten to 
fifteen subjects are assigned to each group. 

3. The number of treatments given within each of the factors is 
arbitrary. However, it is rare that more than four or five treat- 
ments within either or both of the factors are compared. 


EXAMPLE 


Consider a situation where two groups of subjects practice a coordi- 
nation task using a pursuit rotor apparatus. All subjects in both groups 
practice for four 60-second trials with the rotor moving clockwise. Then 
all subjects practice for four 60-second trials with the rotor moving counter- 
clockwise. (Note: If the experimenter decided to counterbalance and have 
half the subjects practice under the counterclockwise condition first, this 
would then be a Latin square design. ) 

The two experimental groups are formed as follows. One group prac- 
tices under a schedule where the four practice trials (under both the 
clockwise and counterclockwise conditions) consist of 60 seconds of practice 
with 60 seconds of rest between each practice trial. The other group 
practices for 60 seconds with only 10 seconds of rest between each trial. 
Thus, the present experiment permits evaluation of (1) the effects of the 
amount of rest between practice trials, (2) the effects of the direction of 
rotation, and (3) changes across practice trials. The response measured 
for all subjects under all treatments is time on target during each 60-second 
trial. 

Step 1. After the data have been collected, they are tabled as follows. 


GROUP 1 (60-SECOND PRACTICE/60-SECOND REST) 


Clockwise Counterclockwise 
Subject Trial1 Trial 2 Trial 3 Trial 4 Trial1 Trial 2 Trial3 Trial 4 
Sy 21 26 35 43 2 9 20 24 
So 18 28 41 46 5 10 14 15 
S3 25 24 45 48 10 15 21 21 
Ss 19 20 38 37 1 3 8 7 
Ss 14 18 25 33 4 4 12 20 
Ss Lz 16 28 29 8 10 18 25 
S7 12 18 29 35 6 13 24 28 
Ss 15 17 27 30 1 7 Ay, 26 
So 20 28 26 29 2 4 16 14 
Sto 18 20 31 38 9 23 36 39 
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GROUP 2 (60-SECOND PRACTICE/10-SECOND REST) 


Su 15 Pf 26 30 11 14 17 20 
Sie 6 9 i 24 15 14 19 22 
Sis 22 23 28 26 10 18 16 13 
Su 18 26 29 32 16 18 15 21 
Sis 11 16 15 18 2 1 6 9 
Sie 14 22 22 32 Gf 11 10 14 
Sir 19 21 24 29 9 12 11 17 
Sis 16 17 17 22 13 17 21 20 
Sis 12 16 25 23 4 9 14 19 
S29 10 wz, 16 iff 8 10 15 15 


Step 2. Add the scores for each treatment in both experimental 
groups. (Note: If you are using a calculator, Step 2 and Step 3 can be 
done at the same time.) 


GROUP 1 


Clockwise Counterclockwise 


Subject Triall Trial2 Trial3 Trial 4 Triakle» Trial2 » Triali8e | Trials: 


St 21 26 35 43 2 9 20 24 

So 18 28 41 46 5 10 14 15 

Sums: 179 215 325 368 48 101 186 219 
GROUP 2 

Su 15 17 26 30 1 14 17 20 

Siz 6 9 17 24 15 14 19 22 

Sums: 143 179 219 253 95 124 144 170 


Step 3. Square each number in the entire table (Step 1), and then 
add the squares. 


21? + 18? + --- + 15? = 69,810 


Step 4. Add all the sums obtained in Step 2 to get the grand sum 
for the entire table. 


179 + +++ + 48+ +--+ 1484 --- + 95+ --- + 170 = 2068 


Step 5. Square the grand sum obtained in Step 4, and divide it by 
the total number of measures recorded—i.e., the total number of subjects 
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times the number of measures recorded for each subject (in this ex- 
ample, 20 X 8 = 160). This yields the correction term. 
2968? _ 8,809,024 
160 ~—«:160 
Step 6. Computation of the total sum of squares (SS,): Simply 


subtract the correction term (Step 5) from the sum of the squared values 
in Step 3. 


= 55,056.4 


69,810 — 55,056.4 = 14,753.6 = SS, 
Between-Subjects Effects (Steps 7-9) 


Step 7. Computation of the effects of the experimental conditions 
on overall performance (in the present example, the effects of 60- versus 
10-second rest periods—SSgroups) : First, add all the trial sums obtained in 
Step 2 for Group 1 and for Group 2. 


179 + 215 + 325 + 368 + 48 + 101 + 186 + 219 

= 1641 = sum for Group 1 
143 + 179 + 219 + 253 + 95 + 124+ 144+ 170 

= 1327 = sum for Group 2 


Then, square each of these totals, divide each square by the number of 
scores added to get the total (80 in this example), and add the quotients. 


16412. 13272 4,453,810 
80 Ss anu’ Sh 


Then, subtract the correction term (Step 5) from the above value. 


55,672.6 — 55,056.4 = 616.2 = SSgroups 


= 55,672.6 


Step 8. Computation of the between-subjects sum of squares (SSp) : 
First, add the scores for each subject in each group. 


Group 1 


Subject Trial1 Trial2 Trial3 Trial4 Trial1 Trial2 Trial3 Trial4) Sums 


Si 26 +85 48 2 Dt 20, = 2d 180 
So 18 + 28 + 41 + 46 + 5 + 10 + 14 + 15 177 


Bok te Oye Se gpa ay be gilt iy guelsititag tae Bel anaes «and 


Group 2 


Su 15 + 17 + 264+ 320+ i1+ «4+«1~« + «OD 150 
Sie 6+ 9 + 17 + 24 + 15 + 144 + «19 + 22 126 


gee 10 he a eee a Pe he be) ee “to Las + 15" | 103 
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Then, square the sum of each subject’s scores, and add these squares. 
1802 + 1772 + +++ + 103? = 460,482 


Then, divide the above value by the number of scores which were added to 
get the sum for each subject. (In the present example, 8 scores were added 
to get each of the above sums.) 


2 
100882 5 se0.25 


Then, subtract the correction term (Step 5) from the above value. 
57,560.25 — 55,056.4 = 2503.8 = SS 


Step 9. Computation of the between-subjects error term (SSerror,) : 
Simply subtract the sum of squares for groups (Step 7) from the sum of 
squares for between subjects (Step 8). 


2503.8 —= 616.2 = 1887.6 — SSerror, 
Within-Subjects Effects (Steps 10-20) 


Step 10. Computation of the within-subjects sum of squares (SS,): 
Simply subtract the between-subjects sum of squares (Step 8), from the 
total sum of squares (Step 6). 


14,753.6 — 2503.8 = 12,249.8 = SS, 


Step 11. Computation of the sum of squares for the first within- 
subjects factor (here, the clockwise versus counterclockwise rotation— 
SSrotation) : First, add the sums for the clockwise and for the counterclockwise 
conditions (Step 2), disregarding the trials and the rest-period dimensions. 


179 + 215 + 325 + 368 + 143 4+ 179 + 219 + 253 


= 1881 = sum for clockwise 


48 + 101 + 186 + 219 + 95 + 124 + 144 4+ 170 


= 1087 = sum for counterclockwise 


Then, square each of these sums, and divide each square by the number 
of scores added to get each sum. (In this example 80 scores were added to 
obtain each sum.) Then, add the quotients. 


18812 : 1087? 4,719,730 
80 80 ~=—sS 80 


= 58,996.6 


Then, subtract the correction term (Step 5) from the above value. 


58,996.6 = 55,056.4 = 3940.2 mae) SSrotation 
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Step 12. Computation of the sum of squares for the second within- 
subjects factor (here, the effects of trials—SSrias): First, sum the scores 
for each of the four trials (Step 2), disregarding the rotational-direction 
and rest-period dimensions. 


179+ 148+ 48+ 95 = 465 = sum for Trial 1 
215 + 179 + 101 + 124 = 619 = sum for Trial 2 
325 + 219 + 186+ 144 = 874 = sum for Trial 3 
368 + 253 + 219 + 170 = 1010 = sum for Trial 4 


Then, square these sums, and divide each square by the number of scores 
added to get each of the above sums. (In this example, each of the above 
sums represents a total of 40 scores, since 10 subjects’ scores were added to 
get each of the sums in Step 2.) Then, add the quotients. 


A652 ‘2 6192 t 8742 “ 1010? 2,383,362 
40 40 40 Ap 40 


= 59,584.0 


Then, subtract the correction term (Step 5) from the above value. 
59,584.0 — 55,056.4 = 4527.6 = SStriais 


Step 13. Computation of the interaction between experimental groups 
(rest interval) and the first factor (rotational direction) —SSgroups x rotation : 
First, add the sums for each treatment for each of the two groups (Step 2). 
In this example, disregard the trials dimension and obtain the sums for 
the clockwise treatment in Group 1 and the counterclockwise treatment 
in Group 1. Do the same for Group 2. 


179 + 215 + 325 + 368 = 1087 = sum for Group 1, clockwise 
143 + 179 + 219 + 253 = 794 = sum for Group 2, clockwise 

48 + 101 + 186 + 219 = 554 = sum for Group 1, counterclockwise 
95 + 124+ 144+ 170 = 533 = sum for Group 2, counterclockwise 


Then, square these sums, and divide by the number of scores added to 
obtain each sum. (In the present example, each of the above sums represents 
a total of 40 scores.) Then add the quotients. 


10872 ” 7942 | 554? | 533? 2,403,010 
40 40 40 Miu be. 


= 60,075.2 


Then, subtract the correction term (Step 5), the sum of squares for groups 
(Step 7), and the sum of squares for rotational direction (Step 11), from 
the above value. 


60,075.2 on 55,056.4 aay, 616.2 Te 3940.2 — 462.4 — SSagroups X rotation 


Step 14. Computation of the interaction between experimental groups 
(rest interval) and the second factor (trials) —SSgroups x trials: First, add the 
sums for each trial for each of the two groups (Step 2). In the present 
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example, disregard the rotational-direction dimension and obtain the sums 
for Trials 1, 2, 3, and 4 in Group 1. Do the same for Group 2. 


179 + 48 = 227 = sum for Group 1, Trial 1 
215 + 101 = 316 = sum for Group 1, Trial 2 
325 + 186 = 511 = sum for Group 1, Trial 3 
368 + 219 = 587 = sum for Group 1, Trial 4 
143 + 95 = 238 = sum for Group 2, Trial 1 
179 + 124 = 303 = sum for Group 2, Trial 2 
219 + 144 = 363 = sum for Group 2, Trial 3 
253 + 170 = 423 = sum for Group 2, Trial 4 


Then, square each of these sums, and divide by the number of scores added 
to obtain each sum. (In the present example, each sum represents a total 
of 20 scores: 10 subjects and 2 scores per subject.) Then, add the quotients. 

PG pe 423? 1,216,226 


°° yO CO 


= 60,811.3 


Then, subtract the correction term (Step 5), the sum of squares for groups 
(Step 7), and the sum of squares for trials (Step 12) from the above value. 


60,811.83 — 55,056.4 — 616.2 — 4527.6 = 611.1 = SSgroups x trial 


Step 15. Computation of the interaction between the first factor 
(rotational direction) and the second factor (trials) —SSrotation x trials: First, 
add the sums for each trial for both rotational-direction conditions (Step 2). 
In the present example, disregard the groups effects and obtain the sum for 
Trials 1, 2, 83, and 4 under the clockwise condition. Then do the same for 
the counterclockwise condition. 


179 + 143 = 322 = sum for Trial 1, clockwise 
215 + 179 = 394 = sum for Trial 2, clockwise 
325 + 219 = 544 = sum for Trial 3, clockwise 
368 + 253 = 621 = sum for Trial 4, clockwise 

48 + 95 = 143 = sum for Trial 1, counterclockwise 
101 + 124 = 225 = sum for Trial 2, counterclockwise 
186 + 144 = 330 = sum for Trial 3, counterclockwise 
219 + 170 = 389 = sum for Trial 4, counterclockwise 


Then, square each of these sums, and divide by the number of scores added 
to obtain each. (In the present example, each sum represents a total of 
20 scores: 20 subjects and 1 score per subject.) Then, add the quotients. 


322? 304? 389° 1,271,792 
20 20 90. - 4620 


= 63,589.6 


Then, subtract the correction term (Step 5), the sum of squares for rotation 
(Step 11), and the sum of squares for trials (Step 12) from the above value. 


63,589.6 — 55,056.4 — 3940.2 — 4527.6 = 65.4 = SSrotation x trials 


2.9 Three-Factor Mixed Design (2) / 79 


Step 16. Computation of the interaction among groups, rotation, 
and trials (SSgroups x rotation x trials) : First, square each sum obtained in Step 2, 
and divide each square by the number of scores added to obtain each sum. 
(In the present example, each sum represents a total of 10 scores.) Then 
add the quotients. 


1792 215 1702 652,874 
Maal ie Cal aakadodlick snail 


= 65,287.4 


Then, from this value, subtract the correction term (Step 5), the sum of 
squares for groups (Step 7), the sum of squares for rotation (Step 11), 
the sum of squares for trials (Step 12), the sum of squares for groups by 
rotation (Step 13), the sum of squares for groups by trials (Step 14), 
and the sum of squares for rotation by trials (Step 15). 


65,287.4 — 55,056.4 — 616.2 — $940.2 — 4527.6 — 462.4 
—611.1 — 65.4 = 8.1 = SScroups X rotation X trials 


Step 17. Computation of the total error for within subjects (SSerrory,) : 
(Note: This error term is not used in any of the F-tests, but it is needed 
for later computations.) Subtract tne final values of Steps 11, 12, 13, 14, 
15, and 16 from the final value of Step 10. 


12,249.8 — 3940.2 — 4527.6 — 462.4 — 611.1 — 65.4 — 8.1 
=2635.0 = SSeror, 


Step 18. Computation of the error term for the rotation and for the 
rotation-by-groups interaction (SSeror,): This requires that the data be 
retabled as follows. Sum the scores of each subject for the four trials within 
each rotational-direction condition. 


Group 1 


Subject Clockwise Counterclockwise 


Si 125 (21 + 26+ 35+ 43) 55 (2+9-+ 20 + 24) 
So 133 (18 + 28+41+46) 44 (5+10+ 14 + 15) 


Si «107 107 
Group 2 

Su «88 62 

Su 56 70 

Sw 8S 48 


Then, square each of these sums, and divide the squares by the number of 
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scores added to obtain each sum. (In this example, each sum is based on 
4 scores.) Then, add the quotients. 
123? 133? 48? =. 254,140 


eee —_—_ = = 63,535 
4 4 wT er 4 ‘ 


Then, from this value, subtract the correction term (Step 5), the sum of 
squares for between subjects (Step 8), the sum of squares for rotation 
(Step 11), and the sum of squares for rotation by groups (Step 13). 


63,535 — 55,056.4 — 2503.8 — 3940.2 — 462.4 = 1572.2 = SSeror, 


Step 19. Computation of the error term for trials and for the groups- 
by-trials interaction (SSerror,) : This requires that the data be retabled once 
again. Sum the scores of each subject on the four trials, disregarding the 
rotation-direction dimension. 


Group 1 
Subject Trial 1 Trial 2 Trial 3 Trial 4 
Si 23 (21 + 2) 35 (26 + 9) 55 (35 + 20) 67 (43 + 24) 
S2 23 (18 + 5) 38 (28 + 10) 55 (41 + 14) 61 (46 + 15) 
Sto 27 43 67 77 
Group 2 
Su 26 31 43 50 
Sie 21 23 36 46 
Sa 18 22 31 32 


Then, square all the sums in this table, and divide each square by the 
number of scores added to obtain each sum. (In the present example, 2 
scores were added.) Then, add the quotients. 


232 232 322 126,418 
Fee ae ig Soty 


Then, from this value, subtract the correction term (Step 5), the sum of 
squares for between subjects (Step 8), the sum of squares for trials (Step 
12), and the sum of squares for groups-by-trials (Step 14). 


63,209 — 55,056.4 — 2503.8 — 4527.6 — 611.1 = 510.1 = SScnor, 


= 63,209 


Step 20. Computation of the error term for the trials-by-rotation 
interaction and for the trials-by-rotation-by-groups interaction (SSerror;) : 


Simply subtract the final values of Steps 18 and 19 from the final value of 
Step 17. 


2635.0 — 1572.2 — 510.1 = 552.7 = SSenor, 
Step 21. All the computations based directly on the data have been 


2.9 Three-Factor Mixed Design (2) / 81 


completed. However, to compute the F ratios, the degrees of freedom (df) 
are required. These are computed as follows. 


df for SS; = the total number of scores entered in Step 1 
minus 1. 


160 — 1 = 159 


df for SS, = the total number of subjects used in the experi- 
ment minus 1. 


20 —1= 19 
df for SSgroups = the number of groups minus 1. 
2—l1=1 
df for SSerror, = the between-subjects df minus the groups df. 
19-—1=18 


df for SS, = the total df minus the between-subjects df. 
159 — 19 = 140 


df for SSrotatio = the number of different (rotation) conditions 
minus 1. 

2-—-1=1 
df for SStrias = the number of trials given within each con- 
dition minus 1. 


4-—1=3 
df for SSgroups x rotation = the df for groups times the df for 
rotation. 
1xXl=1 
df for SSgroups x trials = the df for groups times the df for trials. 
1xX3=3 
df for SSrotation x trials = the df for rotation times the df for trials. 
1xX3=3 


df for SSgroups x rotation x trials = the df for groups times the df 
for rotation times the df for trials. 
1xX1x3=3 
df for SSeror, = the df for within subjects minus the dfs for 
rotation, trials, groups-by-rotation, groups-by-trials, rotation- 
by-trials, and groups-by-rotation-by-trials. 
140 -—1—3—1-—3—3-—3 = 126 


df for SSeror, (rotation and rotation-by-groups) = the df for 
rotation, times the number of subjects in each group minus 1, 
times the number of groups. 


1X9XK2=18 
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Step 22. 


df for SSeror, (trials and groups-by-trials) = the df for trials, 
times the number of subjects in each group minus 1, times 
the number of groups. 


3X9 XK 2 = 54 


df for SSeror, (rotation-by-trials and groups-by-rotation-by- 
trials) = the df for rotation, times the df for trials, times 
the number of subjects in each group minus 1, times the 
number of groups. 


1X3X9XK2= 54 


The mean squares are then computed as SS/df. 


(Step 7) 616.2 


Toups — = 616.2 
MSgroup: 1 1 
Ne _ (Step 9) _ 18876 _ 4, 
error}, = 18 = 18 = A 
(Step 11) 3940.2 
MSyrotation = = = 3940.2 
1 il 
Step 12 4527.6 
MSrial Baa ae = 1509.2 
3 a 
(Step 13) 462.4 
MSgroups X rotation = = = 462.4 
1 il 
Step 14 Gia 
MSgroups X trials = ( P ) = == AUS / 
3 33 
Step 15 ‘ 
MSrotation X trials — ( =P ) <= = ae es 
3 o 
Step 16 8.1 
MSgroups X rotation X trials = \ =P ) = = 27/ 
3 33 
(Step 18) 1572.2 
MSerror eS = 87.3 
: 18 aoe 
(Step 19) 510.1 
MSerror = = = 9, 
- 54 panera 
Step 20 552.7 
MSerrorg — ( P ) = = 10.2 


54 54 
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Step 23. The appropriate F ratios are as follows. 


Experimental groups: bee 
MSerror, 
. Rt hen MSrotati 
Rotation direction: ee 
MSerror; 
Trials fi MStrials 
MSerror, 
: m: 
Groups-by-rotation: sa ES 
MSerror; 
; m 
Groups-by-trials: ea 
MSerror2 
, ; ms 
Rotation-by-trials: Se 
MSerrorg 
- . MSG x R 
Groups-by-rotation-by-trials: aes 
MSerrorg 
Step 24. Table the results as follows. 
Source SS df ms F p 
Total 14, 753.6 159 — — ~- 
Between subjects 2,503.8 19 — — — 
Groups 616.2 1 616.2 5.88 <.05 
Error, 1,887.6 18 104.9 — — 
Within subjects 12,249.8 140 — _— —- 
Rotation 3,940.2 1 3940.2 45.11 <.001 
Trials 4,527.6 3 1509.2 159.77 <.001 
GXR 462.4 1 462.4 5.29 <.05 
GXxXT (i dp 3 203.7 21.56 <.001 
RX. 65.4 3 21.8 2.13 n.S. 
GSXR LT 8.1 3 2.7 <i ns. 
Error: 1,572.2 18 87.3 — — 
Errore 510.1 54 9.4 — — 
Errors 552.7 54 10.2 —_ -— 


Therefore, it is concluded (see Appendix D) that: 

The overall performance of the groups was different. 

The effects of directional change (rotation) were significant. 

The subjects’ performance changed across trials. 

There was a significant groups-by-direction (rotation) interaction. 
There was also a significant trials-by-groups interaction. 


Se eS 
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SECTION 2.10 
Latin Square Design: Simple 


This Latin square design is basically equivalent to the treatments-by- 
subjects design of Section 2.5, except that the effects of the order of treat- 
ment presentation can also be analyzed. This design is discussed in the 
following textbooks.! 


Cochran, W. G., and G. M. Cox. Experimental Designs, 2nd ed. New York: 
John Wiley & Sons, Inc., 1957. Chapter 4, pp. 117ff. 

Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 15, pp. 
254-280. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 12, 
pp. 258-265; Chapter 13, 273-281. 

McNemar, Q. Psychological Statistics, 3rd ed. New York: John Wiley & 
Sons, Inc., 1962. Chapter 16, pp. 340-345. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 10, pp. 514-548. 


Points to Consider When Using the Simple Latin Square Design 


1. All subjects in all of the experimental subgroups receive the same 
experimental treatments. The only difference between the sub- 
groups is in the order of presentation of these treatments, which 
is systematically counterbalanced. For example, if three drugs 
were being tested, every subject would receive each of the drugs, 
but one third of the subjects would be given Drug 1 first, the 
second third Drug 2 first, and the final third Drug 3 first. 

2. There should be an equal number of subjects in each of the experi- 
mental subgroups. In most experiments, five to fifteen subjects 
are assigned to each subgroup. 

3. It is rare that more than four or five treatments are administered 
to each of the subjects. Note: The number of treatments is always 
equal to the number of experimental subgroups in a Latin square 
design. 


EXAMPLE 


Assume that an experimenter wishes to determine the effects of three 
different shock intensities on the galvanic skin responses of a group of 


1 There are many variations of this design. The texts listed below present basically the same approach 
as this analysis but vary in some of the specifics of the Latin square arrangements. 
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subjects. Since it seems reasonable to expect that the order in which the 
shocks are presented might affect the results, he decides to counterbalance 
the effects of the shock by using a Latin square design. To do this, one 
third of the subjects receive low-intensity shock followed by medium and 
then high. The second third of the subjects receive medium-intensity 
shock first followed by high and then low. The remaining third receive 
high, low, and then medium. The measure recorded is the number of 
responses above a certain criterion during the fifteen trials given under 
each shock condition. 

In this experiment, the presentation of the shock intensities will be as 
follows. (The subgroups will hereafter be referred to simply as “groups.’’) 


Shock Intensity 


Order of Presentation 


Medium High 


Group 2 Group 3 
Group 1 Group 2 
Group 3 Group 1 


Or, rearranging the group and order-of-presentation dimensions, the above 
becomes: 
Shock Intensity 


Low Medium High 


First Second Third 
Third First Second 
Second Third First 


(Note: This rearrangement permits computations to be made more easily 
but does not affect the actual computational procedures.) 
Step 1. After the experiment has been conducted, table the data as 


follows. 
Group 1 (Order: Low, Medium, High) 


Low Shock Medium Shock High Shock 
Subject (First) (Second) (Third) 


Si 
S2 
Ss 
Ss 
Ss 
Se 
Sr 


ry 


re 
omonmouoaoon 


Nok WO D 
OD orn 0 oD 


— 
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Group 2 (Order: Medium, High, Low) 


(Third) (First) (Second) 
Ss 8 6 2 
Sy 4 6 
Sto 11 8 9 
Su 6 6 6 
Sia 14 8 Ly 
Sis 9 5 6 
Sus 8 5 8 


Group 3 (Order: High, Low, Medium) 


(Second) (Third) (First) 
Sts 8 9 9 
Sie 8 9 12 
Si 10 9 10 
Sis 9 11 ital 
Sig 7 8 9 
So 10 8 13 
Sa 7 4 8 


Step 2. Add the scores in each group for each shock intensity. 


Group 1 
Low Medium High 
Subject (First) (Second) (Third) 
Sy 4 6 7 
So 6 8 9 
Sums: 34 57 57 
Group 2 
(Third) (First) (Second) 
Ss 8 6 2 
So 9 4 6 
Sums: 65 42 54 
Group 3 
(Second) (Third) (First) 
Sis 8 9 9 
Sie 8 9 12 
Sums: 59 58 72 
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Step 3. Obtain the sum for each group by adding the sums of the 
shock intensities. 


34 + 57 + 57 = 148 = sum for Group 1 
65 + 42 + 54 = 161 = sum for Group 2 
59 + 58 + 72 = 189 = sum for Group 3 


Step 4. Add the scores for each subject in each group. (Note: If you 
are using a calculator, Step 5 can be done at the same time as Step 4.) 


Group 1 
Subject Low Medium High Sums 
Si 4 4 6 + fi 17 
So 6 eet 8 + 9 23 
Sr A Sipetio yh Sai0 36 
Group 2 
Ss Sie Go Scie 2 16 
So» 9 + 4 + 6 19 
Su 8 stk ble os 21 
Group 3 
Sis 8 + 9 + 9 26 
Si¢ 8 + 9 + 12 29 
Sn 7 moet ~s 19 


Step 5. Square each score in the entire table (Step 1), and add these 
squared values to get a grand sum of the squares. (Note that in the following 
example we are considering the scores as they go across—not down—the 
table.) 

V4+@+7+6483+94+---+7+4 4+ 8 = 4500 

Step 6. Add the group sums (Step 3) to get the grand sum of the 
entire table. 

148 + 161 + 189 = 498 


Step 7. Square the grand sum, and divide it by the total number 
of measures in the entire table—i.e., the number of subjects times the 
number of measures per subject (21 X 3 = 63 in this example). This 
yields the correction term. 

498? = 248,004 
GBs 68 


Step 8. Computation of the total sum of squares (SS,): Simply 
subtract the correction term (Step 7) from the sum of the squares (Step 5). 


4500 — 3936.571 = 563.429 = SS; 


= 3936.571 
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Step 9. Computation of the between-subjects sum of the squares 
(SS,): First, square the sum of each subject’s scores (Step 4), and add 
these squared values. 


172 + 23? + --- + 19? = 12,756 


Then, divide this value by the number of different shock intensities given 
each subject (i.e., the number of different orders). 


12,756 


= 4252 


Then, subtract the correction term (Step 7) from the above value. 
4252 — 3936.571 = 315.429 = SS, 


Step 10. Computation of the effects of groups—SSg (i.e., the effects 
of order of presentation of the shock intensities on the overall group 
performance) : First, square the sum of each of the experimental groups 
(Step 3), divide each squared value by the number of measures on which 
the sum was based, and then add these values. 

148? ae 161? 189? 83,546 


21 21 21 21 


= 3978.381 


Then, subtract the correction term (Step 7) from the above value. 
3978.381 — 3936.571 = 41.810 = SSc 


Step 11. Computation of the between-subjects error term (SSerron,) : 
Simply subtract the SSq (Step 10) from the SS, (Step 9). 


315.429 = 41.810 — 273.619 = SSerron, 
Within-Subjects Effects (Steps 12-16) 


Step 12. Computation of the within-subjects sum of squares (SS): 
Simply subtract the SS, (Step 9) from the SS; (Step 8). 


563.429 — 315.429 = 248.0 = SS, 


Step 13. Computation of the treatment effects (in this example, 
the effects of low- versus medium- versus high-intensity shock—SSs) : 
First, add the sums of all subjects when they received low shock (Step 2). 
Do the same for medium and high shock. 


34 + 65 + 59 = 158 = sum for low shock 
57 + 42 + 58 = 157 = sum for medium shock 
57 + 54 + 72 = 183 = sum for high shock 


I 


2.10 Latin Square Design: Simple / 89 


Then, square each of these sums, divide by the number of measures on 
which each sum was based, and add the quotients. 
158? 15? £857) 16 8a 402 
re ons ot 


= 3957.238 


Then, subtract the correction term (Step 7) from the above value. 
3957.238 — 3936.571 = 20.667 = SSs 


Step 14. Computation of the order effects—SSo (ie., the general 
effects of firstness versus secondness versus thirdness, irrespective of the 
particular shock intensity): First, add the sums of the shock intensities 
presented first, second, and third (Step 2). 


34 + 42 + 72 = 148 = sum of shocks presented first 
57 + 54 + 59 = 170 = sum of shocks presented second 
57 + 65 + 58 = 180 = sum of shocks presented third 


Then, square these sums, divide by the number of measures on which each 
sum was based, and then add the quotients. 


148? 170? 180? 83,204 
+= +4+— = 


= 3962.095 
21 21 21 21 


Then, subtract the correction term (Step 7) from the above value. 
3962.095 — 3936.571 = 25.524 = SSo 


Step 15. Computation of the effects of a particular shock intensity 
being presented first versus second versus third—SSsgo,, (SS for shock X 
order within subjects): First, square the sums of each shock intensity in 
each of the nine experimental groups (Step 2), divide by the number of 
measures on which the sums were based (7 in this example), and then add 
the quotients. 


DAA SO ery aha OOS i ater 4 547 59? 
2 7 7 7 7 7 


7 7 7 


58? 2 28,0 
58 72 = 8,588 aya, 


Then, from this value, subtract the correction term (Step 7). 
4084 — 3936.571 = 147.429 


Then, from this value, subtract SSg (Step 10), SSs (Step 13), and SSo 
(Step 14). 


147.429 — 41.810 — 20.667 — 25.524 = 59.428 = SSso, 
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Step 16. Computation of the within-subjects error term (Sse 
Simply subtract SSs (Step 13), SSo (Step 14), and SSgo,, (Step 15) from 
SS, (Step 12). 


248 — 20.667 — 25.524 — 59.428 = 142.381 = SSeror,, 
Step 17. All computations based on the data have been completed: 


SS: = 563.429 (Step 8) 

SS, = 315.429 (Step 9) 

SSg = 41.810 (Step 10) 
SSerror, = 273.619 (Step 11) 
SS, = 248.000 (Step 12) 
SSs = 20.667 (Step 13) 
SSo = 25.524 (Step 14) 


SSso, = 59.428 (Step 15) 
SSerrory = 142.381 (Step 16) 


Since the F ratios are the ratios of mean squares (SS/df), the df must 
be determined, as follows. 


df for SS; = total number of measures recorded minus 1. 
63 — 1 = 62 

df for SSp = total number of subjects minus 1. 
21,—1.=20 


df for SSq = number of experimental subject groups minus 1. 


3—-l=2 
df for SSeron, = Af for SS, minus the df for SSg. 
20 — 2 = 18 
df for SSy = df for SS; minus the df for SSp. 
62 — 20 = 42 


df for SSs = number of treatment conditions minus 1. 


a leas 
df for SSo = number of different orders of presentation 
minus 1. 

3) — 1) Sy 


df for SSso, = number of treatment groups minus 2, times 
the number of orders minus 1. 

(8 —2) X 8-1) =2 
df for SSeror, = df for SS, minus the dfs for SSs, SSo, and 
SSso,- 

42 —-2—2-—2= 36 
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Step 18. Compute the mean squares needed for the analysis (SS/df). 


ms; (This value is not needed. ) 
Ms) (This value is not needed. ) 
(Step 10) 41.810 
MSc = = = 20.905 
Zz 2 
a _ (tepll) — 273.619 15:201 
error}, 18 = 18 = . 
ms, (This value is not needed. ) 
(Step 13) 20.667 
msg = = = 10.333 
2 2 
(Step 14) 25.524 
fs tS a = 12.762 
2 2 
Step 15 59.428 
Gaga. 0! SBHaDHS ea = 29.714 
De 2 
Step 16 142.381 
MSerror,, = \ = ae 2 - = 3.055 


36 36 


Step 19. Compute the F ratios and table the data as follows. 


Source Ss) df ms F p 
Total 563.429 62 — —_ — 
Between subjects 315.429 20 — — — 
Groups (SO,) 41.810 2 20.905 1.38 N.S. 
Error, 273.619 18 15.201 -- — 
Within subjects 248.000 42 — — _- 
Shock (S) 20. 667 2 10.333 2.61 n.8. 
Order (O) 25.524 2 12.762 3.23 n.s. 
Shock X order, (SOw) 59.428 2 29.714 7.51 < .005* 
Error w 142.381 36 3.955 — — 


Therefore, it is concluded (see Appendix D) that the within-subjects 
shock and order effects were interactive. All other effects were non- 


significant. 


* The p value listed is taken from an F table for the appropriate degrees of freedom. However, according 
to Lindquist (1953, p. 280), in the instance where the source of variation is mixed (SOp and SOw), each 
component should be tested at the X/2% level. In that case, it would be concluded that the SOy interaction 
is significant at the .025 rather than the .005 level. 
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SECTION 2.11 
Latin Square Design: Complex 


The complex Latin square design is essentially an extension of the 
simple Latin square. The basic difference is that one extra between-subjects 
dimension is added. The major advantage of this Latin square design is 
that it allows the use of many fewer separate groups of subjects to cover 
the treatment combinations of interest. This design is discussed in the 
following textbooks. 


Cochran, W. G., and Cox, G. M. Experimental Designs, 2nd ed. New York: 
John Wiley & Sons, Inc., 1957. Chapter 4, pp. 117ff. 

Lindquist, E. F. Design and Analysis of Experiments in Psychology and 
Education. Boston: Houghton Mifflin Company, 1953. Chapter 13, 
pp. 285-288. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 10, pp. 554-563. 


Points to Consider When Using the Complex Latin Square Design 


1. Two or more main experimental subject groups are employed 
and are either treated differently or are selected on the basis of 
some criterion so that they differ (for example, high- versus 
medium- versus low-anxious subjects) . 

2. Within each of the main experimental subject groups, a number 
of subgroups are formed, corresponding to the size of the Latin 
square (i.e., if the square is 3 X 3, then each main group is divided 
into three subgroups). 

3. An equal number of subjects should be assigned to each of the 
subgroups. In most experiments, five to fifteen subjects are as- 
signed to each subgroup. 

4. It is rare that more than four or five treatments are administered 
to each of the subjects. (Note: The number of treatments ad- 
ministered to each subject is always equal to the number of 
subgroups in a Latin square design. 


EXAMPLE 


Assume that an experimenter wishes to determine the effects of three 
different difficulties of verbal material on the learning ability of high- versus 


1 Again, there are many variations of this design. The textbooks listed differ somewhat in the specific 
details and uses of it. Basically, however, they are the same. 
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low-anxious subjects. However, he hypothesizes that if the three different 
difficulties of material were given to each subject, the order in which 
they were presented would affect the rate of learning. Therefore, instead of 
presenting the lists in the same order (for example, hard first, medium 
second, and easy last) to all the subjects in both experimental groups 
(high- versus low-anxious), he decides to counterbalance the difficulty ef- 
fects by using a Latin square design. Consequently, within both the high- and 
low-anxiety conditions, the order of presentation of the lists is system- 
atically varied so that an equal proportion of the subjects receive the 
hard, medium, and easy lists first, second, and third in counterbalanced 
order. The measure recorded by the experimenter is the number of trials 
needed to reach the criterion of one perfect recitation of each of the lists. 

For the high- and low-anxious subjects, the presentation of the lists 
is as follows. (The subgroups will hereafter be referred to simply 
as ‘“‘groups.’’) 


Low-Anxious Subjects 


. Type of List 
Order of Presentation 


Hard Medium Easy 
First Group 1 Group 2 Group 3 
Second Group 3 Group | Group 2 
Third Group 2 Group 3 Group 1 


High-Anxious Subjects 


First Group 4 Group 5 Group 6 
Second Group 6 Group 4 Group 5 
Third Group 5 Group 6 Group 4 


Or, rearranging the group and order-of-presentation dimensions for both 
the high- and low-anxious subjects, the above becomes: 


Low-Anxious Subjects 


Type of List 


caper Hard Medium Easy 
Group 1 First Second Third 
Group 2 Third First Second 
Group 3 Second Third First 
High-Anxious Subjects 
Group 4 First Second Third 
Group 5 Third First Second 


Group 6 Second Third First 
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(Note: This rearrangement permits computations to be made more easily, 
but it in no way affects the actual computational procedures. ) 

Step 1. After the experiment has been completed, table the data as 
follows. 


LOW-ANXIOUS SUBJECTS 
Group 1 (Order: Hard, Medium, Easy ) 


Hard List Medium List Easy List 


Subject (First) (Second) (Third) 
Si 20 16 9 
So 14 15 Zi 
S3 18 10 11 
Ss 16 12 10 
Ss 18 9 12 
Se 19 14 10 


Group 2 (Order: Medium, Easy, Hard) 


(Third) (First) (Second) 
S7 17 17. 9 
Ss 16 18 9 
So 12 i5 8 
Sto 11 15 10 
Su 13 13 12 
Ste 15 16 12 


Group 3 (Order: Easy, Hard, Medium) 


(Second) (Third) (First) 
Sis 19 9 11 
Sus 14 8 U8" 
Sts 13 6 14 
Sie 14 12 10 
Sir 16 10 15 
Sis 18 16 13 


HIGH-ANXIOUS SUBJECTS 
Group 4 (Order: Hard, Medium, Easy) 


Hard List Medium List Easy List 


Subject (First) (Second) (Third) 
Si9 26 16 @ 
S29 23 16 6 
So 21 11 8 
S22 19 11 6 
Sos 24 10 8 
Sx 27 12 10 
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Group 5 (Order: Medium, Easy, Hard) 


(Third) (First) (Second) 
Sos 14 17 8 
So 15 18 6 
Sx 11 16 6 
Sog 13 16 9 
Soo 15 PS 11 
S30 13 vip 10 


Group 6 (Order: Easy, Hard, Medium) 


(Second) (Third) (First) 
S31 19 10 10 
S32 15 9 11 
S33 14 7 6 
S34 13 12 10 
S35 15 10 9 
S36 17 11 8 


Step 2. Add the scores in each group for each level of list difficulty. 


LOW-ANXIOUS SUBJECTS 


Group 1 
Hard Medium Easy 
Subject (First) (Second) (Third) 
Si 20 16 9 
So 14 15 7 
Sums: 105 76 59 
Group 2 
(Third) (First) (Second) 
UJ THe A hh ee 
S7 ie 17 9 
Ss 16 18 9 
Sums: 84 94 60 
Group 3 
(Second) (Third) (First) 
[ee oe ee. eee ere 
Sis 19 9 11 


Su 14 8 13 


Sums: 94 61 76 
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HIGH-ANXIOUS SUBJECTS 


Group 4 
Hard Medium Easy 
Subject (First) (Second) (Third) 
Sio 26 16 fl 
S20 23 16 6 
Sums: 140 76 45 
Group 5 
(Third) (First) (Second) 
Sos 14 ilps 8 
Sve 15 18 6 
Sums: 81 91 50 
Group 6 
(Second) (Third) (First) 
S31 19 10 10 
S32 15 9 11 
Sums: 93 59 54 


Step 3. Obtain the sum for each group by adding the sums for each 
level of list difficulty. 


105 + 76 + 59 = 240 = sum for Group 1 
84 + 94 + 60 = 238 = sum for Group 2 
94 + 61 + 76 = 231 = sum for Group 3 

140 + 76 + 45 = 261 = sum for Group 4 
81 + 91 + 50 = 222 = sum for Group 5 
93 + 59 + 54 = 206 = sum for Group 6 


Step 4. Add the scores for each subject in each group. (Note: If you 
are using a calculator, Step 5 can be done at the same time as Step 4.) 


LOW-ANXIOUS SUBJECTS 


Group 1 
Subject Hard Medium Kasy Sums 
Si 20 + 16 + 9 45 


Se 14 aP 15 a tf 36 


Ss 10. tec 2 ids een 43 
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Group 2 
Sy ime eal al aaa 43 
Ss 6 a Maas eting 43 
c. lio ce 1G eee 8 43 
Group 3 
Sis 102 wet O beet © 9h 39 
Si 14 8 13 35 
Se Tew hie iy LTD 47 


HIGH-ANXIOUS SUBJECTS 


Group 4 
Subject Hard Medium Easy Sums 
Sig 26 aF 16 a5 7 49 
Sao 23 Ste 16 ae 6 45 
ne Sent 49 
Group 5 
Sos 14 + ile + 8 39 
Sos 15 Se 18 ar 6 39 
Soo 13 aie 11 ate 10 34 
Group 6 
Ss 19 ar 10 ae 10 39 
S32 15 =f 9 + 11 35 
Sos 17 + 1 + 8 36 


Step 5. Square each score in the entire table (Step 1), and add these 
squared values to get a grand sum of the squared numbers. 


20? + 162+ 9? 4+ 147+ 1579+ 74+ --- + 17+ 11? + & = 20,106 


Step 6. Add the group totals (Step 3) to get the grand sum for the 
entire table. 


240 + 238 + 231 + 261 + 222 + 206 = 1398 


Step 7. Square the grand sum of Step 6, and divide it by the total 
number of measures recorded in Step 1—i.e., the number of subjects times 
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the number of measures per subject (36 X 3 = 108 in this example). 
This yields the correction term. 


1398? 1,954,404 
108 —«108 


= 18,096.333 


Step 8. Computation of the total sum of squares (SS;): Simply 
subtract the correction term (Step 7) from the sum of squares obtained in 
Step 5. 

20,106 — 18,096.333 = 2009.667 = SS; 


Between-Subjects Effects (Steps 9-13) 


Step 9. Computation of the between-subjects sum of squares (SS,) : 
First, square the sum of each subject’s scores (Step 4), and add these 
squared values. 


45? + 367+ --- + 36? = 55,080 


Then, divide this value by the number of scores added to obtain each of 
the sums obtained in Step 4. (In the present example, each sum represents 
3 scores. ) 


55,080 
———— = 13,300 


Then, subtract the correction term from the above value. 
18,360 — 18,096.333 = 263.667 = SS, 


Step 10. Computation of the “pure” between-groups effects (SS): 
(The other “between” components in this design are partially between- and 
partially within-subjects sources of variance. In the present example, 
the overall effects of high versus low anxiety are not confounded.) First, 
add the group sums (Step 3) for the subjects in the low-anxious conditions 
(Groups 1, 2, and 3) and for subjects in the high-anxious conditions 
(Groups 4, 5, and 6). 


240 + 238 + 231 
261 + 222 + 206 


709 = sum for low-anxious Ss 


689 = sum for high-anxious Ss 


Then, square each of these sums, divide by the total number of scores 
that make up each sum, and add the quotients. 


709? i 6892 977,402 


=1 : 
BA Seen 8,100.037 


Then, subtract the correction term (Step 7) from the above value. 


18,100.037 — 18,096.333 = 3.704 = SS, 
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Step 11. Computation of the between-subjects list-by-order inter- 
action (SSro,): First add the sums for the groups that received the same 
order of presentation of the lists (Step 3), disregarding the effects of high 
versus low anxiety. 


240 = sum for Group 1 
+261 = sum for Group 4 


501 = sum for all Ss who received the lists in the order: 
hard, medium, easy 


238 = sum for Group 2 
+222 = sum for Group 5 


460 = sum for all Ss who received the lists in the order: 
easy, hard, medium 


231 = sum for Group 3 
+206 = sum for Group 6 


437 = sum for all Ss who received the lists in the order: 
medium, easy, hard 


Then, square the above sums, divide each squared value by the number 

of measures on which the sum was based, and then add the quotients. 
501? | 460" | 437 653,570 
Soolson: Gu 7eaeG 


= 18,154.722 


Then, subtract the correction term (Step 7) from the above value. 
18,154.722 — 18,096.333 = 58.389 = SSro, 


Step 12. Computation of the between-subjects list-by-order-by-anx- 
iety interaction (SSzroa,) : First, square the sum of each of the experimental 
groups (Step 3), divide each squared value by the number of measures on 
which the sum is based, and then add the quotients. 


2402 —- 288? 231? | 261? 222 2062 327,446 
18 18 18 18 18 i eewe lk: 


= 18,191.444 


Then, from the above value, subtract the correction term (Step 7), the 
SSa (Step 10), and the SSzo, (Step 11). 


18,191.444 — 18,096.333 — 3.704 — 58.389 = 33.018 = SSroa, 


Step 13. Computation of the between-subjects error term (SSerox,) : 
Simply subtract the SS, (Step 10), SSro, (Step 11), and SSroa, (Step 12) 
from the SS, (Step 9). 


263.667 — 3.704 — 58.389 — 33.018 = 168.556 = SSeron, 
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Within-Subjects Effects (Steps 14-21) 


Step 14. Computation of the within-subjects sum of squares (SSw) : 
Simply subtract the SS, (Step 9) from the SS, (Step 8) 


2009.667 — 263.667 = 1746.0 = SS, 


Step 15. Computation of the list effects (SS_): (In this example, 
these are the effects of a hard versus medium versus easy list, disregarding 
the order and anxiety effects.) First, add the scores of all the subjects 
when they received the hard list (Step 2). Do the same for the medium 
and easy lists. 


105 + 84+ 94+ 140 + 81 + 93 = 597 = sum for hard list 
76+ 94+ 61+ 764+ 91 + 59 = 457 = sum for medium list 
59+ 60+ 76+ 45+ 50 + 54 = 344 = sum for easy list 


Then, square each of these sums, divide by the number of measures on 
which each sum was based, and add the quotients. 


597? “A 457? be 3447 683,594 


= 18,088.722 
36 36 36 36 : 


Then, subtract the correction term (Step 7) from the above value. 


18,988.722 — 18,096.333 = 892.389 = SS. 


Step 16. Computation of the order effects (SSo): (In this example, 
these are the general effects of firstness versus secondness versus thirdness 
of list presentation, irrespective of anxiety level or the particular list 
presented.) First, add the sums of the lists presented first, second, and 
third (Step 2). 


105 + 94 + 76 + 140 + 91 + 54 = 560 = sum of lists presented first 
76 + 60+ 94+ 76+ 50+ 93 = 449 = sum of lists presented second 
59 + 84+ 61+ 45 + 81 + 59 = 389 = sum of lists presented third 


Then, square these sums, divide by the number of measures on which each 
sum was based, and add the quotients. 


560? = 449? : 389? 666,522 ee iae 

BONS oh S01 Seerooe 

Then, subtract the correction term (Step 7) from the above value. 
18,514.5 — 18,096.333 = 418.167 = SSo 


Step 17. Computation of the effects of each type of list being pre- 
sented first versus second versus third, disregarding the effects of anxiety 
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(SSro,,) : First, add the sums of the high- and low-anxious groups for each 
of the treatment and order combinations (Step 2). 


105 + 140 = 245 = sum of hard list first 
76 + 76 = 152 = sum of medium list second 
59 + 45 = 104 = sum of easy list third 
94 + 91 = 185 = sum of medium list first 
60 + 50 = 110 = sum of easy list second 
84 + 81 = 165 = sum of hard list third 
76 + 54 = 130 = sum of easy list first 
94 + 93 = 187 = sum of hard list second 
61 + 59 = 120 = sum of medium list third 


Then, square each of the above sums, divide each square by the number 
of measures on which each sum is based, and then add the quotients. 


2452 =: 1522 i 1202 233,764 
12 12 12, dD 


= 19,480.333 


Then, from this value, subtract the correction term (Step 7), the sum of 
squares for LO, (Step 11), the sum of squares for lists (Step 15), and the 
sum of squares for order (Step 16). 


19,480.333 — 18,096.333 — 58.389 — 892.389 — 418.167 
= 15.055 = SSro0, 


Step 18. Computation of the treatments-by-“pure’’-between-groups 
interaction (in this example, the list-by-anxiety interaction—SS za) : First, 
add the sums of the hard, medium, and easy lists within each of the anxiety 
conditions (Step 2), disregarding the effects of order of presentation of 
these lists. 


105 + 84 + 94 = 283 = sum of hard lists, low-anxious Ss 
76 + 94 + 61 = 231 = sum of medium lists, low-anxious Ss 
59 + 60 + 76 = 195 = sum of easy lists, low-anxious Ss 
140 + 81 + 93 = 314 = sum of hard lists, high-anxious Ss 
76 + 91 + 59 = 226 = sum of medium lists, high-anxious Ss 
45 + 50 + 54 = 149 = sum of easy lists, high-anxious Ss 


Then, square the above sums, divide by the number of measures on which 
each sum was based, and add these quotients. 


2832 2312-195? 314? 226° 1492 343,348 
18 18 18 18 18 i 18 


= 19,074.889 


Then, from this value, subtract the correction term (Step 7), the sum of 
squares for anxiety (Step 10), and the sum of squares for lists (Step 15). 


19,074.889 — 18,096.333 — 3.704 — 892.389 = 82.463 = SSxa 
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Step 19. Computation of the order-by-“pure’’-between-groups inter- 
action (here, the order-by-anxiety interaction—SSo,) : First, add the sums 
of the lists presented first versus second versus third within each of the 
anxiety conditions (Step 2), disregarding the effects of list difficulty. 


105 + 94 + 76 = 275 = sum of first lists, low-anxious Ss 
76 + 60 + 94 = 230 = sum of second lists, low-anxious Ss 
59 + 84 + 61 = 204 = sum of third lists, low-anxious Ss 
140 + 91 + 54 = 285 = sum of first lists, high-anxious Ss 
76 + 50 + 93 = 219 = sum of second lists, high-anxious Ss 
45 + 81+ 59 = 185 = sum of third lists, high-anxious Ss 


Then, square the above sums, divide by the number of measures on which 
each sum was based, and add these quotients. 


215" 230? — 204" - 285* 21 IBS 3a3,002 
~ += 


= 18,530.667 
18 18 18 18 18 18 18 


Then, from this value, subtract the correction term (Step 7), the sum of 
squares for anxiety (Step 10), and the sum of squares for order (Step 16). 


18,530.667 — 18,096.333 — 3.704 — 418.167 = 12.463 = SSoa 


Step 20. Computation of the within-subjects lists-by-order-by-anx- 
iety interaction (SSzoa,,): First, square the sums of each list within each 
experimental group (Step 2), divide by the number of measures on which 
each sum was based, and then add the quotients. 

LOR. oF Gs BO? 84? 0 OF 


gf fe Tag yg 


932 592 542 117,896 
6 6 gy CS 


= 19,649.333 


From the above value, subtract the correction term (Step 7), the sum of 
squares for anxiety (Step 10), the sum of squares LO, (Step 11), the 
sum of squares LOA, (Step 12), the sum of squares for lists (Step 15), 
the sum of squares for order (Step 16), the sum of squares LO, (Step 
17), the sum of squares LA (Step 18), and the sum of squares OA (Step 19). 


19,649.333 — 18,096.333 — 3.704 — 58.389 — 33.018 — 892.389 
— 418.167 — 15.055 — 82.463 — 12.463 = 37.352 = SSroa, 
Step 21. Computation of the within-subjects error term (SSenor,) : 
From the within-subjects sum of squares (Step 14), subtract the sums of 
squares for lists (Step 15), order (Step 16), lists X order within (Step 17), 


lists X anxiety (Step 18), order X anxiety (Step 19), and list X order X 
anxiety (Step 20). 


1746.000 — 892.389 — 418.167 — 15.055 — 82.463 
ee 12.463 +52 Soe — 288.111 = SSerror, 
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Step 22. All computations based on the data have been completed: 


SS, = 2009.667 (Step 8) 
SSp = 263.667 (Step 9) 
Sa = 3.704 (Step 10) 
SSro, = 58.389 (Step 11) 


SSroa, = 33.018 (Step 12) 
SSerror, — 168.556 (Step 13) 


SS, = 1746.000 (Step 14) 
SS1 = 892.389 (Step 15) 
SSo = 418.167 (Step 16) 
SSto, = 15.055 (Step 17) 
SSo, = 12.463 (Step 19) 


SSroa, = 37.352 (Step 20) 
SSeror, = 288.111 (Step 21) 


Since the F ratios are ratios of mean squares (SS/df), the df must be 
determined, as follows. 


df for SS; = total number of measures recorded minus 1. 
108 — 1 = 107 


df for SS, = total number of subjects minus 1. 


36 — 1 = 35 
df for SSa = number of “pure” between-subjects groups 
minus 1. 

2—1=1 


df for SSiro, = number of treatments (lists) minus 1. 
3—1=2 
df for SStoa, = number of treatments minus 1, times the 
number of “‘pure’’ between-subjects groups minus 1. 
(8—1) X (2-1) =2 
df for SSerorn, = df for SS, minus the dfs for SSa, SSxo,, 
and SSroa,- 
35 —1—2—2 = 30 
df for SS, = df for SS; minus the df for SS». 
107 — 35 = 72 
df for SSx = number of treatment groups minus 1. 
3—1=2 
df for SOo = number of orders of presentation minus 1. 
3—1=2 
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df for SSuo, = number of treatments minus 1, times the 
number of orders minus 2. 


(3 = 1): KS = 2) = 2 


df for SSra = number of treatments minus 1, times the 
number of ‘‘pure’”’ between factors minus 1. 


(8—1) X (2-1) =2 


df for SSo, = number of orders minus 1, times the number 
of “pure” between factors minus 1. 


(8 —1) X (2-1) =2 


df for SSroa, = number of treatments minus 1, times the 
number of orders minus 2, times the number of ‘pure’ 
between factors minus 1. 


3: 1) X% @6—2 X= 1) —2 


df for SSeror, = af for SS, minus the dfs for SSz, SSo, SSro,, 
SSra, SSoa, and SSroay: 


72—2—-—-2-—-2-—-2—2-—-2=60 


Step 23. Computation of the mean squares needed for the analysis 


(ms = SS/df): 


ms; (This value is not needed. ) 
Msp (This value is not needed. ) 
Step 10 .704 
dria faiel a eRe lg 5 BIUS (ss on 
1 1 
(Step 11) 58.389 
INSEOR 9 = = 29.194 
Step 12 33.018 
MSLoA, = \ re ) = : = 16.509 
(Step 13) 168.556 
Trory) ct = == e(oy | 
MSerron, 30 30 5.619 
MSy (This value not needed. ) 
(Step 15) 892.389 
msz = = = 446.194 
2 2 
(Step 16) 418.167 
MSo = = = 209.083 


2 2 


MSzLoy 


MSspa 


MSoa 


MSLOAW 


MSerrory 


li 
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(Step 17) _ 15.055 


2 


(Step 18) _ 82.463 


2 


(Step 19) _ 12.463 


2 


(Step 20) 37.352 


2 


(Step 21) _ 288.111 


a Wanee 
peor 41.231 
oe oe 6.231 
gras 18.676 
= 4.802 


60 


60 


Step 24. Compute the F ratios and table the data as follows. 


Source ss df ms F p 

Total 2009 . 667 107 — = = 
Between subjects 263 . 667 35 — —_— = 
Anxiety 3.704 1 3.704 .66 ns. 

List X order, 58.389 Be 29.194 5.20 <.025* 

List X order, X anxiety, 33.018 2 16.509 2.94 D.s. 
Error, 168.556 30 5.619 — —— 
Within subjects 1746 .000 72 — -— — 
List 892.389 2 446.194 92.92 <.001 
Order 418.167 2 209 .083 43.54 <.001 
List X ordery 15.055 2 1.527 E57 n.s. 
List X anxiety 82.463 2 41.231 8.59 <.001 
Order X anxiety 12.463 2 6.231 1.30 n.s. 
List X ordery X anxiety y 37.352 2 18.676 3.89 <.05 
Error, 288.111 60 4.802 — —_ 


Therefore, it is concluded (see Appendix D) that: 
1. The effects of list difficulty and order of presentation interacted. 
2. The overall effects of list difficulty were significant. 
3. The overall effects of order of presentation were significant. 
4 


The effects of anxiety and list difficulty interacted. 


* The p values listed are those taken from F tables for the appropriate degrees of freedom. However, ac- 
cording to Lindquist (1953, p. 280), in those instances where the sources of variation are mixed (LOp and 
LOw, and LOA, and LOAw) each component should be tested at the X /2% level. In that case, it would be 
concluded that only the LO» of the mixed sources is significant (at the .05 rather than the .025 level). 


PART 3 


Supplemental Computations for Analysis of Variance 


The next seven sections present supplemental computations that are 
often needed to make a more complete and accurate analysis of data than 
is possible with the tests in Parts 1 and 2. The seven tests specifically treated 
in these sections are grouped below into three general types; then, a more 
detailed description of each test follows. This introductory material should 
help you to decide which test or tests will satisfy the demands of your 
particular data analysis. 


1. Tests for equality of variances 

2. Tests for “simple effects’—usually used when an interaction is 
found to be significant 

3. Trend tests—used to determine whether linear, quadratic, and 
higher complex relationships are present in the data 


Tests for Equality of Variances (Sections 3.1, 3.2, and 3.3) 


Most statistical tests have a clearly stated requirement that popu- 
lation variances must be equal. Sections 3.1, 3.2, and 3.3 present simple 
tests to determine whether this is true. Any one of these tests may also 
be used to determine whether two experimental treatments produce an 
effect in terms of different variances. 

Section 3.1 presents a test for equality of two independent variances. 
Section 3.2 is concerned with a test for equality of two related variances. 
(Related variances are variances computed from two measures of the same 
people or measures of matched people.) Section 3.3 presents a test for 
equality of several independent variances. 
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Tests for Simple Effects (Sections 3.4, 3.5, and 3.6) 


When the more complex analyses, such as those presented in Part 2, 
are completed, a researcher may wish to perform additional analyses on 
certain portions of the data. Sections 3.4-3.6 present several ways of dealing 
with such “simple effects.” If the experimenter plans from the beginning 
to compare several specific pairs of means, the best approach is the one 
presented in Section 3.4. If he waits until he looks at his data and then 
decides to make certain tests on the basis of the way the data look, the 
procedure in Section 3.5 should be followed. 

When the very complex analyses of Sections 2.6-2.11 are used, there 
are several complete factorial or completely randomized analyses that may 
be done before the more simple comparisons of two means are done. Section 
3.6 presents a series of questions that might be asked and subsequently 
answered in such complex research situations. 


Tests for Trend (Section 3.7) 


Occasionally, a researcher is confronted with a problem which requires 
that he describe the shape of the data points, or the type of equation that 
best fits the several points. In this case, the analyses presented in Section 
3.7 would best serve his needs. 


SECTION 3.1 


Test for Difference Between Variances of Two 
Independent Samples (Test for Homogeneity of 


Independent Variances) 


There are two cases in which it is desired to do a significance test of 
the difference between two independent variances: (1) when an experi- 
mental hypothesis is concerned with the variability of the samples and 
(2) when there is doubt concerning the requirement of equality of variances 
in a mean-difference test. In either case, the following procedure may be 
followed in testing the hypothesis of equal variances. 
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Step 1. Presumably, you already have the two variances (or the two 
variance estimates, i.e., mean squares). If you do not, go to Section 1.2 
and follow the instructions in the first six steps. The value arrived at in 
Step 6 will be the variance for one of the samples. When you have both 
variances, go on to Step 2 of this section. 

Step 2. Obtain the F ratio by placing the larger variance of Step 1 
over the smaller. For example, suppose the two variances are 


126.81 


I 


variance; 


variance, = 35.27 
Then, 


Step 3. Before the F value can be evaluated for significance, the 
degrees of freedom associated with each variance must be determined. In 
all cases, the degrees of freedom for a variance (actually a population- 
variance estimate) will be one less than the number of cases on which the 
variance is based. For example, suppose variance; of Step 2 had been 
computed from a sample of 41 cases. Then, 


df for variance; = 41 — 1 = 40 


In the same way, suppose variance, had been computed from a sample of 
31 cases. Then, 


df for variancey = 31 — 1 = 30 


Step 4. The F value of Step 2 (3.60 in this example) has the two 
degrees of freedom 40 and 30 associated with it. From tabled F values 
(see Appendix D), we find that when df = 40/30,! F values larger than 
2.47 are significant at the .01 level. Since the ratio of the variances in the 
present example equals 3.60, it is concluded that the variances are not 
homogeneous (equal). 

However, there is one slight complication due to the fact that we 
selected only the larger variance as the numerator of the F ratio. A cor- 
rection is needed to take care of the selection of only the larger variance 
as the numerator of F. In all cases, this correction is accomplished very 
simply by multiplying the probability value by 2. Thus, an F value of 
2.47, with degrees of freedom equal to 24/30, is considered significant at 
the .02 level rather than at the .01 level. 


1 Since the df of 40/30 are not listed, go to the next closest df values. In this instance, it would be 24/30. 
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SECTION 3.2 


Test for Difference Between Variances of Two Related 


Samples (Test for Homogeneity of Related Variances) 


There are two cases in which it is desired to do a significance test of 
the difference between two related (correlated) variances: (1) when an 
experimental hypothesis is concerned with the variability of the samples 
and (2) when there is doubt concerning the requirement of equality of 
variances in a mean-difference test. In either case, the following procedure 
may be followed in testing the hypothesis of equal variances. 

Step 1. Presumably, you already have the two variances (or the 
two variance estimates, i.e., mean squares). If you do not, go to Section 1.2 
and follow the instructions in the first six steps. The value arrived at in 
Step 6 will be the variance for one of the samples. When you have both 
variances, go on to Step 2 of this section. 

Step 2. Since these samples are related (correlated), the degree of 
the relationship must be determined. Compute the correlation between 
the pairs of scores. This is done by following the directions from Step 1 
through Step 18 in Section 4.1. For the present example, suppose the com- 
puted correlation is +.64. 

Step 3. Subtract the smaller variance of Step 1 from the larger 
variance. For example, suppose 


variance; = 65.27 


variance, = 243.61 
Then, 
243.61 — 65.27 = 178.34 


Step 4. Multiply the two variances together. 
243.61 X 65.27 = 15,900.425 


Step 5. There were two groups of scores from which the two variances 
of Step 1 were computed. Subtract 2 from the number of cases in one group. 
For example, suppose each group is composed of 36 scores. 


36 — 2 = 34 
Step 6. Take the square root of the final value of Step 5. 
1/34 = 5.831 
Step 7. Multiply the final value of Step 6 by the final value of Step 3. 
5.831 X 178.34 = 1039.9 


Step 8. Subtract the result of Step 2 from the number 1. (Note: The 
number 1 is always used.) 
1 — .64 = .36 
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Step 9. Multiply the final value of Step 4 by the number 4. (Note: 
The number 4 is always used.) 


4X 15,900.425 = 63,601.7 


Step 10. Multiply the value obtained in Step 9 by the result of 
Step 8. 
63,601.7 X .36 = 22,896.612 


Then, take the square root of the product. 


4/22,896.612 = 151.316 


Step 11. Divide the final value of Step 7 by the final value of Step 10. 
This yields the ¢ statistic. 
1 NaS « 
AL AI6 


Step 12. The degrees of freedom for the ¢ is the result of Step 5 
(34 in this example). A ¢ with 34 degrees of freedom that is larger than 
2.042 (see Appendix B) is significant at the .05 level using a two-tailed 
test. If the computed ¢ value is large enough to be significant, this means 
that the variances are very likely really different. 


SECTION 3.3 


Test for Differences Among Several Independent 
Variances (F-Maximum Test for Homogeneity of 


Variances)! 


There are two cases in which it is desired to do a significance test of 
the differences among several independent variances: (1) when an experi- 
mental hypothesis is concerned with the variability of the samples and 
(2) when there is doubt concerning the requirement of equality of variances 


1A Master’s thesis completed at Ohio University in 1967 by Mr. Henry Winkler titled ‘‘An empirical 
sampling study testing the robustness of several tests of homogeneity of variance and Type I errors in the 
simple randomized analysis of variance,” dealt with the power of the Fy,,, Bartlett’s, Cochran’s, and 
Levine’s two tests for homogeneity of variance. His results indicate that the Fyyax test and Bartlett’s test 
are the most robust and are to be preferred over the others. Because of its simplicity, the F max is probably 
the best choice. 
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in a mean-difference test. In either case, the following procedure may be 
followed in testing the hypothesis of equal variances. There is one re- 
striction on the use of this Fax test: the sizes of all the samples must be 
the same. 

Step 1. Presumably, you already have the several variances (or the 
variance estimates, i.e., mean squares). If you do not, go to Section 1.2 
and follow the instructions in the first six steps. The value arrived at in 
Step 6 will be the variance for one of the samples. When you have all the 
variances, go on to Step 2 of this section. 

Step 2. Obtain the Frynax ratio by placing the largest variance of 
Step 1 over the smallest. For example, suppose we had computed five 
variances in Step 1: 


variance: = 18.99 
varlances, = 27.62 
variance; = 92.63 
variances = 77.38 


variance, = 26.40 
Then, 


Step 3. The number of degrees of freedom is always one less than 
the number of cases in each sample. Suppose that the size of each sample 
is 18. Then, 


df=18—-1=17 


Step 4. The significance of the F,.x ratio computed in Step 2 is 
obtained from a table of Frmax values (see Appendix H). We must know 
both the number of degrees of freedom (17 in this example) and the 
number of variances being considered (5 in this example). From the table 
of Fimax Values, we see that when df = 17 and the number of variances = 5, 
a value larger than 4.37 is significant at the .05 level. Since the value com- 
puted in Step 2 above (4.88) is larger than 4.37, we conclude that these 
variances are not homogeneous (i.e., they are different). 
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SECTION 3.4 


The t-Test for Differences Among Several Means 


After an F ratio has been found to be significant, the ¢-test is often 
used to determine which specific means differ significantly from each other. 
There is a subtle theoretical difference between when it is appropriate to 
use the ¢-tests for multiple comparisons and other tests such as Duncan’s 
(see Section 3.5), Newman-Keuls’, Tukey’s, etc. 

When multiple comparisons are planned before the experiment has 
been carried out, you can be sure that the tabled probability will be accurate 
for each of the tests (provided that the assumptions underlying the f¢-test 
are not grossly violated). Therefore, if you plan from the beginning to do 
all possible t-tests (or any selected few), there will be no problem. 

However, if you wait until the experiment has been completed, look 
at the data, and then do tests on only the few most widely different values, 
you are guilty of a severe violation of a tenet of probability theory. The 
tabled probability value will hold only when you have planned from the 
beginning of the data-gathering phase to compare specific mean differences; 
there is a basic difference between selecting a difference at random and 
selecting only the largest difference among many. The various multiple- 
comparison techniques have been developed to keep the probability at the 
tabled value when the already-collected data are used to aid in stating 
the hypothesis to be tested. 

In summary, if you plan from the beginning of the design phase to 
analyze specific mean differences, each t-test can be used with the tabled 
probability of being wrong even though the hypothesis is true. If you wait 
until the data are in front of you before you choose specific hypotheses 
based on the data, then you must use a test that will correct the probability 
for your choosing to state your hypothesis after the fact. 


EXAMPLE 


The set of data used to demonstrate the computational procedures is 
that used for the simple randomized design presented in Section 2.1. The 
data presented in the final analysis were: 


Source SS df ms F p 
Total 1132 47 — — — 
Between groups 567 3 189.00 14.71 <.001 


Within groups 565 44 12.84 ~- — 


3.4 The t-Test: Several Means / 113 


The significance of the overall F indicates only that out of the means of 
the four groups, at least two differ. The problem is to determine which 
pairs of means are significantly different. 

Step 1. Obtain the mean score for each group. (In this example, there 
are 12 scores in each group.) 


| bE 

Sum of Group 1 = 111 core 9.25 = mean of Group 1 
88 

Sum of Group 2 = 88 ioe 7.33 = mean of Group 2 
156 

Sum of Group 3 = 156 ae 13.00 = mean of Group 3 
195 

Sum of Group 4 = 195 er 16.25 = mean of Group 4 


Step 2. Derive the standard error of the difference among means by 
2 MSwithin 
m (per gp.) 


2 X 12.84 
12 


For this example, 


= V2.14 = 1.463 


If there are unequal numbers of cases in some groups, you must account 
for those unequal ns. If the ns are not too disparate (as a rough rule of 
thumb, if there are not more than twice as many in the largest group as 
in the smallest group), you may use 7, the harmonic mean of the numbers, 
where 


number of groups 


t= 


il 1 1 1 
mE ag 


For example, suppose that 1; = 12, ne = 8, ns; = 10, and m = 6. Then, 


Pe eeu taee wee 


So the standard error of the differences between means would be 


aoe = /3.05 = 1.746 
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If the ns are widely different, the standard error must be computed 
separately for each comparison as 


Yom caes 
MSwithin { — + — 
Ny Noe 
For example, if ny = 16, ne = 6, and mSyithin = 12.84, we would have 


12.84 ue 
4/12.84 (ee + 4 fae 


= —V/.80 + 2.14 = V/2.94 = 1.715 


A new standard error must then be computed for each new ¢-test. 

Step 3. The needed ¢ value is obtained from Appendix B (p = .05). 
The table is entered at the row headed by the df for the mean square 
within groups. In the present example, the df for mSyithin is 44. Since 44 is 
not listed, go to the next closest df, which is 40. Reading into the table, 
for 40 df, at the .05 level, 


t = 2.02 


Step 4. Now multiply the ¢ value of Step 3 by the value obtained 
in Step 2. This gives the critical difference against which the several mean 
differences will be compared. 


2.02 X 1.463 = 2.955 = C. diff. 


Step 5. Testing the differences between the various means: In all 
instances, if the difference between any two means (see Step 1) is larger 
than the critical difference (in this case, 2.955), then the means are assumed 
to be significantly different. 


Group 1 vs. Group 4 (C. diff. = 2.955): 
16.25 — 9.25 = 7.00 (significant) 
Group 1 vs. Group 3 (C. diff. = 2.955) : 
13.00 — 9.25 = 3.75 (significant) 
Group 1 vs. Group 2 (C. diff. = 2.955): 
7.33 — 9.25 = 1.92 (nonsignificant) 
Group 2 vs. Group 4 (C. diff. = 2.955): 
16.25 — 7.33 = 8.92 (significant) 
Group 2 vs. Group 3 (C. diff. = 2.955): 
13.00 — 7.33 = 5.67 (significant) 
Group 3 vs. Group 4 (C. diff. = 2.955): 
16.25 — 13.00 = 3.25 (significant) 
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SECTION 3.5 
Duncan’s Multiple-Range Test for Nearly Equal ns'” 


While the ¢ test is often used for making multiple comparisons after 
the F has been found to be significant, a more stringent test procedure is 
Duncan’s multiple-range test (see the discussion at the beginning of 
Section 3.4). 


EXAMPLE 


The set of data used to demonstrate the computational procedures is 
that used for the simple randomized design presented in Section 2.1. 
Data from the final analysis of that example are: 


Source ss df ms F D 
Total 1132 47 — — — 
Between groups 567 3 189.00 14.71 <.001 
Within groups 565 44 12.84 — — 


The significance of the overall F means only that among the means of the 
four groups, at least two differ. The problem is to determine which specific 
groups actually differ significantly. 

Step 1. Obtain the mean score for each group. (In this example, 
there are 12 scores per group.) 


111 

Sum of Group 1 = 111 iS 9.25 = mean of Group 1 
88 

Sum of Group 2 = 88 rs 7.33 = mean of Group 2 
156 

Sum of Group 3 = 156 Hoe? 13.00 = mean of Group 3 
195 

Sum of Group 4 = 195 He 16.25 = mean of Group 4 


1 For unequal ns, see C. Y. Kramer, Extension of multiple range tests to group means with unequal 
numbers of replications, Biometrics, 1956, 12, 307-310. 

2 Other multiple-range tests are the Newman-Keuls, Tukey (a) and (b), and Scheffe, discussed by B. J. 
Winer, Statistical Principles in Experimental Design, New York, McGraw-Hill Book Company, 1962, pp. 
77-104. ‘ 
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Step 2. Derive the standard error of the means by 
MSvwithin 
n (per gp.) 


12.84 _ 
i. J 


For this example, 


4/1.07 = 1.03 


If there are unequal numbers of cases in some groups, you must account. 
for those unequal ns. If the ns are not too disparate (as a rough rule of 
thumb, if there are not more than twice as many in the largest group as 
in the smallest group), you may use 7, the harmonic mean of the numbers, 
where 


number of groups 


oe 
sesh ema ey 
N3 nN; 


nN N2 


For example, suppose that n; = 12, n2 = 8, n3 = 10, and n, = 6. Then, 
4 _ 4 
Te aat Tart t e409 


So the standard error of the means would be 


12.84 
ass = 71.525 = 1.235 


n= = 8.42 


Step 3. Go to Appendix I (p = .05) to obtain the “significant 
studentized ranges.’’ The table is entered at the row headed by the df for 
the mean square within groups. In the present example, the df for mSwithin 
is 44. Since 44 df is not listed, use the next closest df, which is 40. Reading 
to the right in this row, for the different ranges of means (k) to be compared, 
the vadues are 


k = 2: 2.858 
k = 3: 3.006 
k= 4: 3.102 


Step 4. Multiply each significant range by the value obtained in 
Step 2. The values obtained are the minimum mean differences (R) for 
the given ranges of comparisons. 


k= 2: Re = 2.858 X 1.03 = 2.944 
k = 3: R; = 3.006 X 1.03 = 3.096 
k=4: Ry = 3.102 X 1.08 = 3.195 


Step 5. Testing the differences between the various means: The means 
must first be ranked from smallest to largest in order that the range (k 
value) for each difference can be determined. In this example, the means 
are ranked as: 7.33, 9.25, 13.00, 16.25. In each instance, if the difference be- 
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tween the means (see Step 1) is larger than the minimum for that range 
(Step 4), it is considered to be significant. 
Group 2 vs. Group 4 (Rs = 3.195) 
16.25 — 7.33 = 8.92 (significant) 
Group 2 vs. Group 3 (R3 = 3.096) 
13.00 — 7.33 = 5.67 (significant) 
Group 2 vs. Group 1 (Ry = 2.944) 
9.25 — 7.33 = 1.92 (nonsignificant) 
Group 1 vs. Group 4+ (R; = 3.096) 
16.25 — 9.25 = 7.00 (significant) 
Group 1 vs. Group 3 (Ry = 2.944) 
13.00 — 9.25 = 3.75 (significant) 
Group 3 vs. Group + (Rz = 2.944) 
16.25 — 13.00 = 3.25 (significant) 


Therefore, it is concluded that Groups 2 and 4, 2 and 3, 1 and 4, 1 and 8, 
and 3 and 4 differ significantly in terms of their overall performance. 

Note: There are important theoretical assumptions which determine 
how many comparisons may be made. Since the presentation of these 
assumptions is beyond the scope of this book, the user is referred to: 
Edwards, A. L. Experimental Designs in Psychological Research, rev. ed. 
New York: Holt, Rinehart & Winston, Inc., 1960. Chapter 10, pp. 136-140. 
Or, Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 3, pp. 85-89. 


SECTION 3.6 


F-Tests for Simple Effects 


The F-test for simple effects is most commonly used when one of the 
factorial or mixed designs (Sections 2.2-2.11) yields a significant inter- 
action. 


EXAMPLE 


To demonstrate some of the more commonly used tests of simple 
effects, a complete analysis of the two-factor mixed design of Section 2.7 
will be presented. Although the presentation in this section represents a 
considerably more detailed analysis than is usually carried out, the several 
operations are presented for the sake of completeness. 
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First, recall the final analysis of the mixed design of Section 2.7: 


Source SS df ms F p 

Total 467 98 —_ — — 

Between subjects 181 32 -- -- _- 
Conditions 39 2 19.50 4.12 <.05 

Error, 142 30 4.73 — -- 

Within subjects 286 66 — — — 

Trials 170 2 85.00 52.46 <.001 

Trials X conditions 19 4 4.75 2.93 <.05 

Error w 97 60 1.62 — -- 


The conclusions drawn from this analysis were: 

1. Meaningfulness of material significantly affected overall amount 
learned. 

2. The overall tendency of the subjects was to change (learn) as a 
function of practice (trials). 

3. The subjects in the various groups learned at different rates. 

The specific questions to be answered by the analyses of simple effects 

relate to the differences noted above and can be stated as follows. 


First Question. Which of the three groups (conditions) differ signifi- 
cantly from each other? Since the overall F merely means that of the three 
groups, at least two differ significantly, the problem is to determine which 
specific pairs differ. To analyze these differences, the Duncan’s range test 
will be applied.! 

Step 1. Obtain the overall mean for each of the three groups. The 
sums obtained in Step 3 of the original analysis (Section 2.7) must be 
divided by the number of subjects in each of the experimental groups 
(in this case, 11). 


111 

Sum of Group 1 = 111 cs 10.0909 = mean of Group 1 
124 

Sum of Group 2 = 124 me 11.2727 = mean of Group 2 
160 

Sum of Group 3 = 160 ars 14.5454 = mean of Group 3 


Step 2. Derive the standard error by 


__MSerror, 


nm (per gp.) 


Le = +/.43 = .656 


1 Obviously, t-tests could also be used. 
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Step 3. The significant studentized ranges are obtained from Ap- 
pendix I of Duncan’s multiple-range values (p = .05). The table is entered 
at the row headed by the df for mSeror,, which is 30. Reading to the right 
in this row, for the different ranges of means (k) to be compared, the 
values are 

k 2: 2.888 


k = 3: 3.035 


Step 4. Multiply each significant range by the value obtained in 
Step 2. This gives the minimum mean differences (R) against which the 
actual differences in the means will be compared. 


k=2: R, = 2.888 X .656 = 1.895 
k = 3: Rs = 3.035 X .656 = 1.991 


Step 5. Testing the difference between the various means: In each 
instance, if the difference between the means (see Step 1) is larger than 
the minimum for that range (Step 4), it is considered to be significant. 


Group 1 vs. Group 3 (R; = 1.991): 
14.5454 — 10.0909 = 4.4545 (significant) 


Group 1 vs. Group 2 (R, = 1.895): 
11.2727 — 10.0909 = 1.1818 (nonsignificant) 


Group 2 vs. Group 3 (R2 = 1.895): 
14.5454 — 11.2727 = 3.2727 (significant) 


Therefore, it is concluded that Groups 1 and 3 and Groups 2 and 3 differ 
significantly in terms of their overall performance. 


Second Question. Although the overall tendency of the groups was 
to change (learn) as a function of trials (practice), did each of the groups 
actually improve? (Note: In actuality, most researchers would not be inter- 
ested in this question until the third question had been answered. However, 
since this is merely an example, the various significant effects will be 
treated in order.) 

Step 1. From Step 2 of the original analysis (Section 2.7), obtain 
the sums of the trials for Group 1. 


Sum for Trial 1 = 24 
Sum for Trial 2 = 38 
Sum for Trial 3 = 49 


Step 2. Square each of these values, divide by the number of scores 
on which each sum was based (in this case, 11), and add the quotients. 
242 «38% 86949? = 4421 


— + — + — = — = 401.909 
11 st it i 11 11 
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Step 3. Obtain the grand sum for Group 1. 
24 + 38 + 49 = 111 


Then, square this sum and divide by the total number of scores recorded 
in Group 1. 
yw 12,321 


= 373.364 


Step 4. Subtract the value of Step 3 from that of Step 2. This yields 
the Group 1 sum of squares for trials. 


401.909 — 373.364 = 28.545 = SSrrias for Group 1 


Step 5. The df for this component is equal to the number of trials 
minus 1. 


od 2 


Step 6. Computation of the mean square for the simple trials effects: 
Merely divide the SStias for Group 1 (Step 4) by the df (Step 5). 


28.545 
——— = 14.272 = msmas for Group | 


Step 7. The test of significance (F-test) of the trials effect for Group 1 
is MStrials (Gp. 157 WBerrore (total) « 


14.272 
yp 4272 _ 
1.62 


From Appendix D, it is found that this value, with df 2 and 60, is 
significant (p < .001). Therefore, it is concluded that performance of the 
subjects in Group 1 changed as a function of practice. The same procedures 
should be repeated for Groups 2 and 3. In each instance, the F ratio equals 
MStrials(Group 2 or 9)/ Tarot, (total) « 


Third Question. The trials-by-conditions interaction indicates that 
at least two of the groups of subjects learned at different rates: Which 
groups were they? Comparisons must be made between Groups 1 and 2, 
Groups 1 and 3, and Groups 2 and 3. In the present example, the first 
comparison will be made between Group 1 and Group 2. 

Step 1. From Step 2 of the original analysis (Section 2.7), obtain 
the sums of each of the trials for Group 1 and Group 2. 


Trial 1 Trial 2 Trial 3 


Sums for Group 1 
Sums for Group 2 


24 38 49 
24 43 57 
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Step 2. Obtain the overall sum for each of the groups. 


24 + 38 + 49 = 111 = sum for Group 1 
24 + 43 + 57 = 124 = sum for Group 2 


Then, square these sums, divide by the number of scores on which each 

sum was based, and add the quotients. 
111? 124? 27,697 
S36 oot eos 


= 839.303 


Step 3. Obtain the grand sum for both groups. 
111 + 124 = 235 


Then, square this value, and divide it by the total number of scores recorded 
in Groups 1 and 2. This yields the correction term for the Group 1 versus 
Group 2 comparison. 


235? 55,225 


= 836.742 
66 66 


Step 4. Computation of the Group 1 versus Group 2 effects: Merely 
subtract the correction term (Step 3) from the value obtained in Step 2. 


839.303 — 836.742 = 2.561 = SSzroups for Groups 1 and 2 


Step 5. Computation of the effects of trials for Groups 1 and 2: 
First, obtain the sum of Trials 1, 2, and 3 for both experimental groups 
(see Step 1). 


24+ 24 = 48 = sum for Trial 1 
38 + 43 = 81 = sum for Trial 2 
49 + 57 = 106 = sum for Trial 3 


Then, square each of these sums, divide by the number of scores on which 
each was based, and add the quotients. 
482 81? 106%. -20;101 
pac ungonew O74 Nh -te2 


= 913.682 


Then, subtract the correction term (Step 3) from the above value. 
913.682 — 836.742 = 76.940 = SSiias for Groups 1 and 2 


Step 6. Computation of interaction of trials by conditions (groups) 
for Groups 1 and 2: First, square each of the sums for each trial for Groups 
1 and 2 (Step 1). Divide each value by the number of scores on which 
each sum was based, and then add the quotients. 

DAI BS AO ee ee DF a so hO,090 


pee ee —+—+4—s= = 917.727 
11 11 11 11 ee 11 e 11 11 
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Then, subtract the correction term (Step 3), the SSgroups (Step 4), and 
SSiriais (Step 5) from the above value. 
917.727 — 836.742 — 2.561 — 76.940 
= 1.484 = SStrisls x groups for Groups 1 and 2 


Step 7. The df for this component is equal to the number of trials 
minus 1, times the number of groups minus 1. 


(8 —1)(2-—1) =2 


Step 8. Computation of the ms for the trials-by-groups interaction 
for Groups 1 and 2: Merely divide the SStriats x groups (Step 6) by the df 
(Step 7). 


> = .742 = MStrials X groups for Groups 1 and 2 


Step 9. The test of significance (F-test) is computed as 


MStrials X groups (Gps. 1 and 2) 


fic 
MSerroryw (total) 
Thus, 
WED 
= -——— _ — 40 
1.62 


From Appendix D, it is found that this F value, with df = 2 and 60, 
is nonsignificant. Therefore, it is concluded that the subjects in Groups 1 
and 2 learned at the same rate. The remaining tests of simple interactions 
are carried out in exactly the same way, except that Groups 1 and 3 are 
compared and then Groups 2 and 3. In all instances, the test of significance 
ig f= MStrials X ean MSerrory- 


One Final Question. Was there a sampling error? Although the prob- 
lem is not present in this example, sometimes in mixed designs there is some 
question as to whether the means of the several groups were significantly 
different initially (sampling error). If this were the case, any differences 
noted in the overall analysis would merely be reflecting this error rather 
than indicating any real differences. 

The most common technique used to determine if there has been a 
sampling error is a comparison of the performance of the several groups 
on Trial 1. Although many analyses are used (t-tests of all pairs of groups, 
Duncan’s range test on all pairs, etc.), the F-test is employed most often 
and is a completely randomized design for a particular trial. 

This F-test of groups effects for Trial 1? is computed as follows. 


2 If desired, this same analysis can be applied to any trial. For example, it is often necessary to determine 


if certain groups differed significantly at the end of training. In this case, the analysis would be applied to 
the last trial. 
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Step 1. From Step 1 of the original analysis (Section 2.7), obtain 
the scores for each subject in all three groups on Trial 1. Table these scores 
as follows. 


TRIAL 1 
Group 1 Group 2 Group 3 
Subject Score Subject Score Subject Score 
Si 3 Sie 2 Sog 2 
Se 3 Sis 1 So 3 
Ss 1 Sis 3 Sos 4 
Ss 1 Sis 2 Sog 1 
Ss 2 Sig iu So7 3 
S¢ 4 S17 4 Sos 1 
Sz 4 Sis 1 So9 1 
Ss 1 Si9 1 S30 2 
So 1 S20 2 S31 3 
Sto 2 Sa 3 S32 1 
Su 2 Soo 4 S33 4 


Step 2. Turn to the completely randomized design as presented in 
Section 2.1 and continue with Step 2 of that analysis. The final F value 
(Step 12) will indicate whether there are significant differences among the 
group means on this particular trial. 

Note: If, when the above analysis has been completed, a significant 
conditions (groups) effect is found, multiple t-tests (Section 3.4) or a 
Duncan’s range test (Section 3.5) may be used to determine which specific 
pairs of groups differ. 


SECTION 3.7 
Use of Orthogonal Components in Tests for Trend 


In general, after an F ratio has been found to be significant, the only 
additional tests are those for simple effects (Sections 3.4, 3.5, and 3.6). 
Occasionally, however, it is of interest to determine the shape of the curves 
that best fit the data points of the various experimental groups. If the 
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treatments form an increasing or decreasing continuum, such as trials or 
variations in shock intensity or anxiety level, the treatment effects can be 
further subdivided into trend components by use of orthogonal polynomials. 
The theoretical rationale underlying these analyses is presented in the 
following textbooks. 


Lewis, D. Quantitative Methods in Psychology. New York: McGraw-Hill 
Book Company, 1960. Chapter 10, pp. 398-419. 

Winer, B. J. Statistical Principles in Experimental Design. New York: 
McGraw-Hill Book Company, 1962. Chapter 3, pp. 70-77; Chapter 7, 
pp. 353-369. 


Three examples will be presented: The first is based on the data of 
Section 2.1 (the completely randomized design), the second on data pre- 
sented in Section 2.7 (the two-factor mixed design), and the third on 
data from Section 2.8 (the three-factor mixed design). These examples 
represent the most frequent instances where this type of trend analysis is 
used, but they by no means exhaust the possibilities of application since 
the analysis can be used with any design. It is important to note that 
this type of trend analysis merely gives information regarding the shape 
of the performance curves. The nature of the data and the purpose of the 
experiment determine entirely whether these analyses are worthwhile. 


EXAMPLE 1 


This example is based on the data and results of the completely 
randomized analysis presented in Section 2.1. First, recall the final analysis 
of that section: 


Source 8s df ms F p 

Total 1132 47 ~- -- — 
Between groups 567 3 189.00 14.71 <.001 

Within groups 565 44 12.84 -~ = 


Question. What degree polynomial best approximates the form of 
the curve that connects the data points (group means) of the four groups? 
Step 1. Turn to Appendix K and obtain the appropriate coefficients 
for the re-analysis. Since there are four groups, the coefficients for k = 4 are: 


Linear: —3 —1 +1 +3 
Quadratic: +1 —1 —1 +1 
Cubic: —1 +3 —3 +1 


Step 2. The linear component will be analyzed first. To do this, 
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multiply the swm of each group (Step 2 of the original analysis) by its 
appropriate linear coefficient. 


Sum of Group 1 = 111 111 X (—3) = —333 


Sum of Group 2 = 88 88 X (—1) = — 88 
Sum of Group 3 = 156 156 X (+1) = +156 
Sum of Group 4 = 195 195 X (+3) = +585 


Step 3. Get the algebraic sum of the values obtained in Step 2. 
(—333) + (—88) + 156 + 585 = +320 


Then, square that sum. 
320? = 102,400 


Step 4. Square each of the linear coefficients (Step 1), and sum 
these squared values. 


(—3)? + (-1)?+ 2 + 3? = 20 


Then, multiply the sum by the number of subjects in each group (12 in 
the present example). 


20 X 12 = 240 
Step 5. Divide the value of Step 3 by that of Step 4. 
102,400 


= 426.67 = SSiinear 
240 

Step 6. The test for linear trend is an F ratio that is equal to the 
value of Step 5 divided by the mean square within groups of the original 
analysis. (In the present example, mSyithin = 12.84.) Compute this F, and 
record the value for future use. 

426.67 
Priest = ———~ = 33.22 
a4 

The degrees of freedom (df) for this F ratio are always equal to 1 and the 
df for mSwithin Of the original analysis (44 in the present example). 


After completing the linear computations, the same basic steps must 
be repeated to analyze the quadratic component. 

Step 1. From Step 1 of the linear analysis (or Appendix K), obtain 
the coefficients for the quadratic component. In the present example, 
where k = 4, these are: 


Quadratic : +1 —1 —1 +1 


Step 2. This time multiply the sum of each group by its appropriate 
quadratic coefficient. 


Sum of Group 1 = 111 111 X (+1) = +111 
Sum of Group 2 = 88 88 X (—1) = — 88 
Sum of Group 3 = 156 156 X (—1) = —156 
Sum of Group 4 = 195 195 X (+1) = +195 
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Step 3. Get the algebraic sum of the values obtained in Step 2. 
111 + (—88) + (—156) + 195 = +62 


Then, square this sum. 
+62? = 3844 


Step 4. Square the quadratic coefficients, and sum these squared 
values. 


+ (-)?+ (-)'+P=4 


Then, multiply this sum by the number of subjects in each group. ve the 
present example, the number of subjects per group is 12.) 


4X 12 = 48 
Step 5. Divide the value of Step 3 by that of Step 4. 


3844 
713. == Oe Sausdraie 


Step 6. The test for quadratic trend is an F ratio that is equal to 
the value of Step 5 divided by the mean square within groups of the 
original analysis. Compute this F, and record the value for future use. 

Pr 80.08 | ee 
quadratic — 12.84 =e Ne 
The dfs for this F ratio are always equal to 1 and the df for mSyithin of the 
original analysis (44 in this example). 


Once again the computations must be repeated; this time, analyze 
the cubic component. 

Step 1. Krom Step 1 of the linear analysis (or Appendix K), obtain 
the cubic coefficients. In the present example, where k = 4, these are: 


Cubic: —1 +3 —3 +1 


Step 2. Multiply the sum of each group by the appropriate cubic 
coefficient. 


Sum of Group 1 = 111 11S 1) = —111 
Sum of Group 2 = 88 88 X (+3) = +264 
Sum of Group 3 = 156 156 X (—3) = —468 
Sum of Group 4 = 195 195 X (+1) = +195 


Step 3. Get the algebraic sum of the values obtained in Step 2. 
(—111) + 264 + (—468) + 195 = —120 


Then, square this sum. 
—120? = 14,400 
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Step 4. Square each of the cubic coefficients, and sum these squared 
values. 


CSD) ee (33) 2e pe 1ee-20 


Then, multiply that sum by the number of subjects in each group (12 in 
this example). 


20 X 12 = 240 
Step 5. Divide the value of Step 3 by that of Step 4. 


14,400 


= 60. = cubi 


Step 6. The test of significance for cubic trend is again an F ratio 
that is equal to the value of Step 5 divided by the mean square within 
groups of the original analysis. Compute this 7, and record the value for 
future use. 

60.00 
ane Bas my! 
The dfs are equal to 1 and the df for mSyithin (44 in this example). 

Step 7. Final check for accuracy: Since the sum of squares between 
groups was broken into its several trend components, the sums of the 
linear, quadratic, and cubic components must equal (within rounding error) 
the sum of squares between groups. (In the present example, SS, = 567.) 


426.67 + 80.08 + 60.00 = 566.75 


Note that if the sum of the trend components does not equal the sum of 
squares between groups, an error in computation has been made. 

Step 8. Final tabling of the data: Although there are several ways 
to do this, the following is most often used. 


Source SS df ms F p 
Total 1132 47 — — — 
Between groups 567 3 189.00 14.71 <.001 
Linear 426.67 1 426.67 33.22 <.001 
Quadratic 80.08 1 80.08 6.23 < .025 
Cubic 60.00 1 60.00 4.67 =<-05 
Within groups 565 44 12.84 — — 


The results are interpreted as showing that the data can be best 
described mathematically by a complex equation. The significant linear 
component shows that there is some tendency for the data to lie along a 
straight line. The significant quadratic component shows that there is a 
tendency for the data to deviate from a straight line in an arcing manner. 
A quadratic function is represented by a curving line, such as a parabolic 
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arc. The significant cubic component shows that there is a tendency for the 
data to crisscross a straight line in a regular fashion. A cubic function is 
similar to two connected parabolic arcs, each peaking in opposite directions. 


EXAMPLE 2 


First, recall the two-factor mixed analysis as presented in Section 2.7. 
The final table of the results was as follows: 


Source ss df ms F p 

Total 467 98 — = — 

Between subjects 181 32 — -- — 
Conditions 39 2 19.50 4.12 <.05 

Error, 142 30 4.73 = — 

Within subjects 286 66 — — — 

Trials 170 2 85.00 52.46 <.001 

Trials by conditions 19 4 4.75 2.93 <.05 

Error « 97 60 162 _- _ 


Question. What level of polynomial functions best describes the form 
of the data points of the various within-subjects effects? 

Step 1. Turn to Appendix K, and obtain the appropriate coefficients 
for the re-analysis. In the present example, each subject was measured 
three times (three trials). Therefore, the coefficients for k = 3 are: 


Linear: —] 0 +1 
Quadratic: +1 —2 +1 


Step 2. The linear component will be analyzed first. Go back to 
the data recorded in Step 1 of the original analysis (Section 2.7) and 
multiply each score of each subject by the appropriate linear coefficient. 
In the present example, the retabled data would appear as follows. 


GROUP 1 (LOW-MEANINGFUL MATERIAL) 
Trial Block 1 Trial Block 2 Trial Block 3 
Subject Score X —1 Score X 0 Score X +1 


Sy =} 0 4 
So = 0 4 
S3 —1 0 4 
Ss —I 0 3 
Ss —2 0 5 
So —4 0 6 
Sy —4 0 6 
Ss —1 0 5 
So —1 0 5 
Sto —2 0 3 
Su —2 0 4 
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GROUP 2 (MEDIUM-MEANINGFUL MATERIAL) 


Sie —2 0 6 
Sis ul 0 5 
Si =H 0 7 
Sis —2 0 6 
Si6 ll 0 3 
S17 —4 0 5 
Sig —1 0 4 
Sig =] 0 4 
S29 —2 0 4 
Sai 3 0 6 
Sy —4 0 7 


GROUP 3 (HIGH-MEANINGFUL MATERIAL) 


So4 =3 0 3 
Sos —4 0 U 
Sr —] 0 4 
S27 =3 0 12 
Sog —1 0 2 
Soo —] 0 3 
S30 —2 0 6 
S31 = 0 6 
S32 —1 0 12 
S33 —4 0 7 


Step 3. Obtain the algebraic sum of the “weighted scores” for each 
subject in all groups. (Note: All subsequent linear computations will be 
based on these algebraic sums.) 


Group 1 
Subject Trial Block 1 Trial Block 2 Trial Block 3 Sum 


Si —3 + 0 a 4 a 

Se —3 + 0 52 4 na 

Su —2 0 4 +2 
Group 2 

Siz 29 eee 0 a 6 sir 

S13 —1 + 0 + 5 +4 

Sx —4 0 7 +3 
Group 3 

So —3 a 0 3 0 
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Step 4. Add the subject sums obtained in Step 3 to get the algebraic 
sum for each experimental group. (Note: These group sums may be nega- 
tive.) 


1+1+--+-+2 = +25 = sum of Group 1 
4+4+4 ---+3 = +33 = sum of Group 2 
6+0+-+-+3 = +45 = sum of Group 3 


Step 5. Square each of the subject sums obtained in Step 3, and add 
these squared values to get the overall sum of squares. 


24 12 vee $44 424 oe + HOR F +++ + 8? = 473 


Step 6. Add the group sums obtained in Step 4 to get the overall 
algebraic sum. (Note: Again, this may be a negative value.) 


25 + 33 + 45 = +103 


Step 7. Square each of the linear coefficients (Step 1), and add the 
squared values. 


(—1)?+0?+12=2 


Step 8. Computation of the within-subjects linear component: Divide 
the sum of the squared values obtained in Step 5 by the value of Step 7. 


473 
——' = 236.5 
2 


Step 9. Computation of the repeated-measure effect (trials, in the 
present example) for the linear component: Square the overall algebraic 
sum obtained in Step 6, and then divide by the value of Step 7 times the 
total number of subjects in the experiment (33, in the present example). 


1032 10,609 
——_— = —— = 160.742 
2X 33 66 


Step 10. Computation of the trials-by-groups effect for the linear 
component: First, square each of the group sums obtained in Step 4, 
divide each by the value of Step 7 times the number of subjects in each 
group (11 in the present example), and add the quotients. 

25% 33? 45? 3739 


= ——~ = 169, 
2<h 8x gas ge oe 


Then, from this sum, subtract the value obtained in Step 9. 


169.955 — 160.742 = 9.213 


Step 11. Computation of the error term for the linear component: 
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Simply subtract the values obtained in Steps 9 and 10 from the value of 
Step 8. 


236.5 — 160.742 — 9.213 = 66.545 
Step 12. Computation of the df for each of the above components: 


df for within subjects (see Step 8) = the total number of 
subjects used in the experiment. 


No. of subjects = 33 


df for trials (see Step 9) = 1 in all instances. 
df for the trials-by-groups interaction (see Step 10) = the 
number of experimental groups minus 1. 


s—1=2 


df for the linear-component error term (see Step 11) = df 
for within subjects minus the df for trials and the df for 
trials by groups. 


33 — 1 — 2 = 30 


Step 13. Computation of the required linear mean squares: Simply 
divide each sum of squares value as computed in Steps 8, 9, 10, and 11 by 
its appropriate degrees of freedom (Step 12). The test of significance in 
each instance is an F ratio of the appropriate linear component divided 
by the linear error term. Table the mean-square values and the F ratios 
temporarily as follows. 


Source Ss) df ms PF p 
Within); near 236.50 33 (not needed) — — 
Trials 160.742 1 160.742 72.47 <.001 
Trials by groups 9.213 2 4.606 2.08 n.s. 
Errorjjnear 66.545 30 2.218 — = 


After completing the linear-component computations, the same basic 
steps must be repeated to analyze the quadratic component. 

Step 1. From Step 1 of the linear analysis (or Appendix K), obtain 
the coefficients for the quadratic component. In the present example, 
where k = 3, the coefficients are: 


Quadratic: +1 —2 +1 


Step 2. The data must again be retabled. The same basic procedure 
of Step 2 of the linear analysis is followed except that each score is multiplied 
by its appropriate quadratic coefficient. 
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GROUP 1 
Trial Block 1 Trial Block 2 Trial Block 3 


Subject Score X +1 Score X —2 Score X +1 


Si 3 —6 4 
So 3 —8 4 
S3 1 —6 4 
Ss 1 —4 3 
Ss 2 —6 5 
Se 4 —10 6 
S7 4 —10 6 
Ss 1 —§ 5 
So 1 —§ 5 
Sto Zz —6 3 
Su 2 —4 4 
GROUP 2 
Sie 2 —6 6 
Si3 1 —8 5 
Su 3 —12 7 
S15 2 —8 6 
Si6 1 —4 3 
S17 4 —10 5 
Sis 1 —6 s 
Sig 1 —4 4 
Sro 2 —6 4 
So 3 —10 6 
Soe 4 —12 Y 
GROUP 3 
Sys 2 —8 8 
So4 3 —12 3 
So5 a —14 a 
Soe 1 —14 4 
So7 3 —14 12 
Sos 1 —8 2 
Sag 1 —10 3 
Sao 2 —10 6 
S31 3 —12 6 
S32 1 —10 12 
S33 4 —18 if 


Step 3. Obtain the algebraic sum of the “weighted scores” for each 


subject in all groups. (Note: All remaining quadratic computations will be 
based on these sums. ) 
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Group 1 
Subject Trial Block 1 Trial Block 2 Trial Block 3 Sum 


Si 3 4 (-6-) + 4 +1 

S: 3 + (—8) + 4 =I 

Su ee ee 42 
Group 2 

Sw ig Ce Mes 2 6 +2 

Si3 1 aR (—8) 5 —2 

Ses 4 eg (eat oh 7 out 
Group 3 

Sos 2 + (=p)let 4 8 122 

Sr 3 + (-12) + 3 —6 

Sas 4 + (182) + 7 7 


Step 4. Add the subject sums obtained in Step 3 to get the algebraic 
sum for each group. 


1+ (-—1) +--+ +2 = —3 = sum for Group 1 
2+ (-—2) +--+ + (—1) = —5 = sum for Group 2 
2+ (—6) +--+ + (—7) = —35 = sum for Group 3 
Step 5. Square each of the subject sums obtained in Step 3, and add 
these squared values. 


12 (—1)P$ vee HAF (—2)PH eee + BH (6) ++ 
+ (—7)? = 297 
Step 6. Add the group sums obtained in Step 4 to get the overall 


algebraic sum. 


(—3) + (—5) + (—35) = —43 


Step 7. Square each of the quadratic coefficients (Step 1), and add 
the squared values. 


2+ (-2)?+ 2 =6 


Step 8. Computation of the within-subjects quadratic component: 
Divide the value of Step 5 by that of Step 7. 


297 
— = 49.50 
6 


Step 9. Computation of the trials effect for the quadratic component: 
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Square the value of Step 6, and divide it by the value of Step 7 times the 
total number of subjects used in the experiment (33 in this example). 
(—43)? 1849 


= = = 9.34 
6 XK 33 198 


Step 10. Computation of the trials-by-groups effect for the quadratic 
component: First, square each sum obtained in Step 4, divide each by the 
value of Step 7 times the number of subjects in each group (11 in this 
example), and add the quotients. 

3)" (—5)? (—35)? 1259 
(—3) 4 ) e Jo 
Gx Th. Gx a > 6 x 66 
Then, from this sum subtract the value obtained in Step 9. 
19.08 — 9.34 = 9.74 


Step 11. Computation of the error term for the quadratic com- 
ponent: Simply subtract the values of Step 9 and 10 from the value of 
Step 8. 


= 19.08 


49.50 — 9.34 — 9.74 = 30.42 
Step 12. Computation of the df for each quadratic component: 


df for within subjects = total number of subjects used in 
the experiment. 


No. of subjects = 33 


df for trials = 1 in all instances. 
df for trials-by-group interaction = the number of experi- 
mental groups minus 1. 


3—1=2 
df for the quadratic component error term = df for within 
subjects minus the df for trials and the df for trials by groups. 
33 — 1 — 2 = 30 
Step 13. Computation of the quadratic mean squares: Simply divide 
each of the sums of squares of Steps 9, 10, and 11 by the appropriate df 
(Step 12). The test of significance in each case is an F ratio of the ap- 


propriate quadratic component divided by the quadratic error term. Table 
the data temporarily as follows. 


Source SS df ms F Dp 
Within, nadratic 49.50 33 (not needed) — — 
Trials 9.34 ] 9.34 9.21 <.001 
Trials by groups 9.74 2 4.87 4.80 <H5; 
Errorjuadratic 30.42 30 1.01 — 


Step 14. Final check for accuracy: Since each of the within-subjects 
sums of squares of the original analysis was broken into trend components, 
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the sums of the components must equal (within rounding error) the 
original values. 


Source Linear Quadratic Sum Original 
Within subjects 236.500 + 49.500 = 286.000 286 .00 
Trials 160.742 + 9.340 = 170.082 170.00 
Trials X groups 9.213 + 9.740 = 18.953 19.00 
Error within 66.545 + 30.420 = 96.965 97.00 


Step 15. Final tabling of the analysis: Although there are several 
techniques, the following is used most often. 


Source ss df ms F p 
Within subjects 286 66 — — — 
Trials 170 2 85.000 52.46 <.001 
Linear 160.742 1 160.742 72.47 <.001 
Quadratic 9.340 1 9.340 9.21 <.001 
Trials X groups 19 4 4.750 2.93 <.05 
Linear 9.213 2 4.606 2.08 n.s. 
Quadratic 9.740 2 4.870 4.80 <05 
Error 97 60 1.620 — —— 
Linear 66.545 30 2.218 a — 
Quadratic 30.420 30 1.014 — = 


A significant linear component for the trials effect means that there 
is a tendency for the data to lie along a straight line. The significance of 
the quadratic component means that there is also a tendency for the data 
to follow a quadratic (arcing) function. 

It is more difficult to interpret the quadratic component of the trials- 
by-groups interaction, since at least two sets of data points must be repre- 
sented. 


EXAMPLE 3 


This example is based on the three-factor mixed design presented in 
Section 2.8. First, recall the final analysis in that section: 


Source Ss df ms PF Dp 
Total 1657 111 a —- — 

Between subjects 576 27 — = 
High/low esteem 4 iI 4 <i 
Failure/nonfailure 290 1 290 34.27 <.001 
Esteem X failure 79 1 79 9.34 <.001 

Error, 203 24 8.46 — 

Within subjects i081 84 — — — 
Trials 784 3 261.33 235.43 <.001 
Trials X esteem 1 3 .33 <1 = 
Trials < failure 167 3 55.67 50.15 <.001 
Trials X esteem X failure 49 3 16.33 14.71 <.001 

Error w 80° 72 isa — 
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Question: 


Step 1. 


Analysis of Variance: Supplement 


What level of polynomial functions best describes the form 
of the data points of the several within-subjects effects in this analysis? 

Obtain from Appendix K the appropriate coefficients for the 
re-analysis. In the present example, four measures were recorded for each 


subject (four trials). Therefore, the coefficients for k = 4 are: 


Step 2. The linear component will be analyzed first. Multiply each 
score used in the original analysis by the appropriate linear coefficient, 


Linear: —3 —] +1 +3 
Quadratic: +1 —]l —1 +1 
Cubic: —] +3 —3 +1 


and retable the data as follows. 


GROUP 1 


(HIGH SELF-ESTEEM/FAILURE INSTRUCTIONS) 


Trial 1 Trial 2 Trial 3 Trial 4 
Subject Score X —3 Score X —1 Score X +1 Score X +3 

Si —12 ae 7 27 

S2 =llfss =i 9 33 

Ss Ih =e 10 39 

Ss =o =i 6 27 

Ss iz Oo 9 30 

Se —15 =n 6 24 

S7 == 72) —=5 9 36 
GROUP 2 

(HIGH SELF-ESTEEM/NONFAILURE INSTRUCTIONS) 

Ss 15 =e ) 36 

So =) —5 10 42 

Sto —21 —10 12 39 

Su 15 =e ll 45 

Sie —12 —9 13 45 

Sis =) ERE 9 36 

Sus —18 =H 8 33 
GROUP 3 


(LOW SELF-ESTEEM/FAILURE INSTRUCTIONS) 


Sis 
Sie 
Su 
Sis 
Sig 
S29 
Sa 


==) —4 4 15 
—15 =o 8 20 
115 0 6 24 
—15 —6 7 24 

1) =u 4 15 
—21 =7/ 8 21 
—18 3 8 24 
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GROUP 4 


(LOW SELF-ESTEEM/NONFAILURE INSTRUCTIONS) 
a a a 


Soo —12 —8 10 42 
S23 —15 —10 14 54 
Soa —9 —7 i 54 
S25 —15 —8 11 51 
Sog —18 —11 15 57 
Sez —18 —8 10 45 
Sog —15 —l1 17 60 


Step 3. Obtain and record the algebraic sum of the “weighted scores” 
for each subject in all groups. (Note: All linear computations will be based 
on these sums.) 


Group 1 
Subject ‘Trial 1 Tril2 | Trial3  . Trial4 | Sum 
St SO sek Os Wee ay ee ey, +16 
Se (—18) + (—7) = 9 ot 33 +17 
&; canal A gy) A cn GE i ntagg +16 
Group 2 
Se (deja ot PES ARE bebo o36 +22 
Ss (—9) 5° Ce) oP 10 + 42 +38 
Su Clamps fen sag’ Ogg +16 
Group 3 
Sis 2) Bo Ma ER 4) Bp Aas +6 
Sis (-15) + (-6¢) + 8 + @ +14 
Sa EL OO Re eS +6 
Group 4 
Sos wna eM, Ae +32 
Sos (-15) + (-102) + 14 + 54 +43 
Sos Cabeler elie areteee reo +51 


Step 4. Add the subject sums obtained in Step 3 to get the algebraic 
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sum for each group. Record these sums and whether they are positive or 
negative; they will be used later. 


16+17+ --- +16 = +126 = sum of Group 1 
22 + 88+ --- +16 = +197 = sum of Group 2 
6+14+-+-+ 6=-+ 52 = sum of Group 3 
32 +43 + --- + 51 = +287 = sum of Group 4 


Step 5. Square each of the subject sums obtained in Step 3. Add 
these squared values, and record the sum for later use. 


16? + 172 + --+ + 51? = 21,092 


Step 6. Add the group sums obtained in Step 4 to get the overall 
algebraic sum. Record this sum for later use. 


126 + 197 + 52 + 287 = +662 


Step 7. Square each of the linear coefficients (Step 1), and add the 
squared values. 


(—3)? + (-1)? + 24+ 8 = 20 


Step 8. Computation of the within-subjects linear component: Simply 
divide the overall sum of the squared values obtained in Step 5 by the 
value of Step 7. 


21,092 


= 1054.60 
20 


Step 9. Computation of the repeated-measures (trials) effect for the 
linear component: Square the algebraic sum obtained in Step 6, and divide 
by the value of Step 7 times the total number of subjects used in the 
experiment (28 in the present example). 


6622 438,244 
20x 28 ~—- 560 


= 782.58 


Step 10. Computation of the trials-by-first-factor (self-esteem) linear 
component: First, obtain the algebraic sums for all subjects who were the 
same in terms of the first factor (self-esteem), disregarding the second 
factor (instructions). (See Step 4 for group sums to be added.) 


126 + 197 = 323 = sum of all high-self-esteem subjects 
52 + 287 = 339 


sum of all low-self-esteem subjects 


Then, square these sums, divide each by the value of Step 7 times the 
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number of scores on which each sum was based (14 in this example), 
and add the quotients. 


3232 3397-219, 250 
2 < 14 20 x 14; . 980 


= 783.03 


Then, from this sum, subtract the value obtained in Step 9. 
783.03 — 782.58 = 0.45 


Step 11. Computation of the trials-by-second-factor (instructions) 
linear component: Repeat the computations of Step 10, except using the 
algebraic sums of subjects who were the same in terms of the second 
factor, disregarding the first factor (self-esteem). (See Step 4 for the group 
sums to be added.) First, 


126+ 52 = 178 = sum of all failure subjects 
197 + 287 = 484 = sum of all nonfailure subjects 


Then, 


178? 484 265,940 


= = 949.7 
20x14. 20X14 280 iis 


Then, 
949.78 — 782.58 = 167.20 


Step 12. Computation of the repeated-measures-by-first-by-second- 
factor linear component (trials X_ self-esteem X instructions, in the 
present example) : Square the algebraic sum of each group (Step 4), divide 
each square by the value of Step 7 times the number of subjects in each 
group, and add the quotients. 


1262 1972 522 287? 139,758 
OT WP 96 5C7 0 7. 140 


= 998.27 


Then, from this sum, subtract the values obtained in Steps 9, 10, and 11. 
998.27 — 782.58 — .45 — 167.20 = 48.04 


Step 13. Computation of the linear-component error term: Simply 
subtract the value obtained in the first computation of Step 12 (998.27, 
in the present example) from the value of Step 8 (or subtract the values 
obtained in Steps 9, 10, 11, and 12 from Step 8). 


1054.60 — 998.27 = 56.33 


Step 14. Computation of the df for the linear components: 


df for withininear = the total number of subjects used in the 
experiment. 


No. of subjects = 28 
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df for repeated measures (trials) = 1 (always). 
df for trials by first factor (self-esteem) = the number of 
experimental conditions within the first factor minus 1. 


2—l1=1 


df for trials by second factor (instructions) = the number of 
experimental conditions within the second factor minus 1. 


2-1=1 


df for trials by first by second factor = the df for the first 
factor times the df for the second factor. 


1x1l=1 


df for error = df for within subjects minus df for trials, 
trials by first factor, trials by second factor, and trials by 
first by second factor. 


25 — 1s 1 — Tel = 24 


Step 15. Computation of the mean squares for the linear components: 
Simply divide each sum-of-squares value as computed in Steps 8, 9, 10, 11, 
12, and 13 by its appropriate degrees of freedom. The test of significance 
in each instance is an F ratio of the appropriate linear component divided 
by the linear-component error term. The mean squares and F ratios should 
be tabled as follows for future use. 


Source Ss af ms F 

Within); ear 1054.60 28 (not needed) — 
Trials 782.58 1 782.58 333.01 

T X SE 45 1 45 <a 
TD olnstr. 167.20 il 167.20 71.15 
Deshi instr: 48 .04 1 48.04 20.44 

Errorjinear 56.33 24 2.35 — 


The computations for the linear components have been completed. 
The computations for the quadratic components must now be undertaken. 

Step 1. Obtain the coefficients for the quadratic component from 
Step 1 of the linear analysis (or Appendix K). In the present example, 
where k = 4: 


Quadratic: +1 —] —1 +1 


Step 2. The data must again be retabled. The same basic procedure 
of Step 2 of the linear analysis is followed, except that each score is multi- 
plied by its appropriate quadratic coefficient. 
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GROUP 1 
(HIGH SELF-ESTEEM/FAILURE INSTRUCTIONS) 
Trial 1 Trial 2 Trial 3 Trial 4 


Subject Score X +1 Score X —1 Score X —1 Score X +1 


Si 4 —6 =7 9 
Se 6 —7 —9 11 
Ss 5 —8 —10 13 
Ss 3 —4 —6 9 
Ss 4 —6 —9 10 
Ss 5 —5 —6 8 
Sy 7 —8 —9 12 
GROUP 2 


(HIGH SELF-ESTEEM/NONFAILURE INSTRUCTIONS) 


Ss 5 —8 —9 12 
So 3 —5 —10 14 
Sto iz —10 —12 13 
Su 5 —8 —ll1 15 
Sie 4 —9 —13 15 
Si3 3 —5 —9 12 
Sis 6 —7 —8 11 
GROUP 3 


(LOW SELF-ESTEEM/FAILURE INSTRUCTIONS) 


a 


Sis 3 —4 —4 5 
Si6 5 —6 —8 9 
Si 5 —6 —6 8 
Sis 5 —6 —7 8 
Sia 3 —4 —4 5 
Soo 7 —7 —8§ 7 
Sai 6 —8 —8 8 
GROUP 4 


(LOW SELF-ESTEEM/NONFAILURE INSTRUCTIONS) 


ED 


Soo 4 —8 —10 14 
So3 5 —10 —14 18 
So 3 —7 —12 18 
Sos 5 —8 —l1l1 17 
Sy 6 —ll —15 19 
Sor 6 —8 —10 15 
Sos 5 ill —17 20 
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Step 3. Using the data of Step 2, obtain and record the algebraic 
sum of the “weighted scores” of each subject in all groups. (Note: All 
quadratic computations will be based on these scores.) 


Group 1 
Subject Trial 1 Trial 2 Trial 3 Trial 4 | Sum 
Si 4 -—- (6)= + (7) + 9 0 
Se 6 ek Tigeot (9) 4 il +1 
Sr 7. UD ree a. 42 
Group 2 
Ss 5 + (-8) + (-9 + 12 0 
So 3 + ay eerily + 14 +2 
Sua éuny Ser tape roy Gan ter. 42 
Group 3 
Sis 3 + (4 °+ (-4 + 5 0 
Si6 5 =) (—6) a= (—8) + 9 0 
a 6 Moris lS) tea 8) 8 2 
Group 4 
Sx 4 (egy Setet—10) oI 0 
Sea 5 + (10) + (—14) +. 18 <1 
Sen Be 1 1-0) =9 


Step 4. Add the subject sums of Step 3 to get the algebraic sums for 
each group. Record these sums and whether they are positive or negative. 


O+1+-:- +2 = +6 = sum of Group l 
0+2+--- +2 = +1 = sum of Group 2 
0+0+ --- + (—2) = —2 = sum of Group 3 
O- 1) + 4 — 3) = -- 3 = sum of Group 4 


Step 5. Square each of the subject sums of Step 3. Add these squared 
values, and record the sum for later use. 


Of Pfr FO FMH eee +OPOEp + +0 
+ (-1? + +++ + (—3)? = 76 


Step 6. Add the subject sums of Step 4 to get the overall algebraic 
sum. 


6+1+(-2)+3=+48 
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Step 7. Square and sum the quadratic coefficients (Step 1). 
I+ (-1)?+ (-1)? 4+ =4 


Step 8. Computation of the within-subjects quadratic component: 
Simply divide the value of Step 5 by that of Step 7. 


a 19.00 
4 e 


Step 9. Computation of the trials effect for the quadratic component: 
Square the value of Step 6, and then divide by the value of Step 7 times 
the total number of subjects used in the experiment (28 in this example). 


8? 64 


Ay oR AI 


Step 10. Computation of the trials-by-first-factor (self-esteem) quad- 
ratic component: First, obtain the algebraic sum of the subjects who were 
the same in terms of the first factor (self-esteem in the present example), 
disregarding the second factor. (See Step 4 for the group sums to be added.) 


l| 


6+1=+7 
(-2)+3=41 


sum for all high-self-esteem subjects 
sum for all low-self-esteem subjects 


Then, square these sums, divide each by the value of Step 7 times the 
number of scores on which each sum was based (14 in this example), and 
add the quotients. 
‘e i 50 
af = — = .89 
4x14 4x14 _ 56 


Then, from this value, subtract the value of Step 9. 
89 — .57 = 32 


Step 11. Computation of the trials-by-second-factor (instructions) 
quadratic component: Repeat the computations of Step 10, except using 
the algebraic sums of subjects who were the same in terms of the second 
factor, disregarding the first factor. (See Step 4 for the group sums to be 
added.) First, 


6 + (—2) = +4 = sum of all failure subjects 
1+ 3 = +4 = sum of all nonfailure subjects 
Then, 
2 2 Ve 
. + “ = ¢ S257 
414 4 eld. 56 
Then, 


57 —,.57 = .00 
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Step 12. Computation of the trials-by-first-by-second-factor quad- 
ratic component: Square the sums of Step 4, divide each square by the 
value of Step 7 times the number of subjects in each group, and add the 
quotients. 

6? t (—2)? 3 50 


- + 4 


= = 1.79 
Ax Tied XIE Ge 


Then, from this sum, subtract the values obtained in Steps 9, 10, and 11. 
1.79 — 57 — .82 — .00 = .90 


Step 13. Computation of the quadratic-component error term: Simply 
subtract the value obtained in the first computation of Step 12 from the 
value of Step 8. 

19.00 — 1.79 = 17.21 


Step 14. The df computations for the quadratic component are the 
same as for the linear component. 


df for withinguadratic = the total number of subjects used in 
the experiment. 


No. of subjects = 28 


df for trials = 1 (always). 
df for trials by first factor = number of first-factor conditions 
minus 1. 


yee Oe | 


df for the trials by second factor = number of second-factor 
conditions minus 1. 


deere od | 


df for trials by first by second factor = the df for the first 
factor times the df for the second factor. 


1xX1l=1 


df for errorguadratic = Af for within subjects minus the df for 
trials, trials by first factor, trials by second factor, and trials 
by first by second factor. 


23—-1-—-1—-1-—1=24 


Step 15. Computation of the quadratic mean squares: Again, divide 
the values of Steps 8, 9, 10, 11, 12, and 13 by the appropriate degrees of 
freedom. Compute each F ratio by dividing the appropriate quadratic 
component by the quadratic error term. Table the data temporarily as 
follows. 
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Source Ss df ms F 
Withing yadratic 19.00 28 (not needed) = 
Trials BY / 1 .o7 <1 
T X SE .32 1 32 <l 
T X Instr. .00 1 .00 <1 
T X SE X Instr. .90 1 .90 1,25 
Hrrorguadratic 17.21 24 12 — 


When the computations of the quadratic components have been 
completed, the computation of the cubic components must be undertaken. 
Step 1. Obtain the coefficients for the cubic component from Step 1 
of the linear analysis (or Appendix K). In the present example, where 
k = 4: 
Cubic: —1 +3 —3 +1 


Step 2. Once again, the data must be retabled. This time each score 
is multiplied by its appropriate cubic coefficient. 


GROUP 1 
Trial 1 Trial 2 Trial 3 Trial 4 
Subject Score X —1 Score X +3 Score X —3 Score X +1 

Sy —4 18 —21 9 
So —6 21 —27 11 
S3 —5 24 —30 13 
Ss —3 12 —18 9 
Ss —4 18 —27 10 
Se —5 15 —18 8 
Sy —7 24 —27 12 

GROUP 2 
Ss —5 24 —27 12 
So —3 15 —30 14 
Sio —7 30 —36 13 
Su —5 24 —33 15 
Si —4 27 —39 15 
Sis —3 15 —27 12 
Sis —6 21 —24 11 

GROUP 3 
Sis —3 12 —12 5 
Sis —5 18 —24 9 
S17 —5 18 —18 8 
Sis —5 18 —21 8 
Sig —3 12 —12 5 
S20 —7 21 — 24 7 
8 


So —6 24 —24 
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GROUP 4 
Sx —4 24 —30 14 
So3 —§ 30 —42 18 
Sos —3 21 —36 18 
Sos =5 24 —33 17 
So —6 33 —45 19 
So7 —6 24 —30 15 
Sog =o 33 —§l1 20 


Step 3. Using the data of Step 2, obtain the algebraic sum of each 
subject’s “‘weighted scores.’’ These sums will be used for all cubic compu- 
tations. 


Group 1 
Subject Trial 1 Trial 2 Trial 3 Trial 4 Sum 
Si a eee 18 4 A) 4 9 ee 
Ss i ©) 21 de (—27) + 11 - 1 
S: E Np tick 24 nee | —27) is 12 42 
Group 2 
Ss (—5) + 24 —- (—27) + 12 +4 
So Bh dhe (Seer arid 4 
Su i 6) A) 1 . (—24) of 11 42 
Group 3 
Sis ems) ing ain | oe ek 2S 5 +2 
Sis (—5) ae 18 sia (—24) => 9 —2 
i COR a eo ade Boks 
Group 4 
See (4 "+ 94 soy +4 
Sos Sa | oe eee =e 
Sox (—5) af 33 sp (—51) te 20 es 


Step 4. Add the sums of Step 3 to get the algebraic sum for each 
group. 
2+ (—1) +++: +2 = +42 = sum of Group 1 
4+ (—4) +--+ +2 = —1 = sum of Group 2 
2+ (—2) + +++ +2 = +4 = sum of Group 3 
4+1-+ +--+ (—3) = +9 = sum of Group 4 
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Step 5. Square the sums of Step 3. Add these squared values, and 
record them for later use. 
2? + (—1)? + +++ + 42+ (—4)? + +++ + 22+ (—2)? 
apes seated? ape [ss oe a3)" = 148 


Step 6. Add the group sums of Step 4 to obtain the overall algebraic 
sum. 


2+(-1I)+4+9=+414 
Step 7. Square and sum the quadratic coefficients (Step 1). 
I fa ae a bl es 
Step 8. Computation of the within-subjects cubic component: Simply 
divide Step 5 by Step 7. 
148 


— = 7.40 
20 


Step 9. Computation of the cubic-component trials effect: Square 
the value of Step 6. Then, divide by the value of Step 7 times the total 
number of subjects used in the experiment. 

1d? 1695196 
20 X 28 560 


= .35 


Step 10. Computation of the trials-by-first-factor (self-esteem) cubic 
component: First, obtain the algebraic sum of the subjects who were the 
same in terms of the first factor, disregarding the second factor. (See 
Step 4 for the group sums to be added.) 


2+ (—1) = + 1 = sum of high-self-esteem subjects 
4+ 9 = +13 = sum of low-self-esteem subjects 


Then, square these sums, divide each by the value of Step 7 times the 
number of scores on which each sum was based, and add the quotients. 


ate 170 | 


a Se -61 
20x 14 20x 14 280 


Then, from this value, subtract the final value of Step 9. 
.61 — .85 = .26 


Step 11. Computation of the trials-by-second-factor (instructions) 
cubic component: Repeat the computations of Step 10, except that the 
algebraic sums of the second factor are used, disregarding the first factor. 
(See Step 4 for the group sums to be added.) First, 


2+ 4 = 6 = sum of failure subjects 


(—1) + 9 = 8 = sum of nonfailure subjects 
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Then, 


6 in 82 100) ga. 
9096TL + 2056 145-280 Si 


Then, 
36 — .35 = .01 


Step 12. Computation of the trials-by-first-by-second-factor cubic 
component: Square the sums of Step 4, divide each by the value of Step 7 
times the number of subjects in each group, and add the quotients. 

22 (—1)? 4? 92 102 


~ “ ~ 


=> = .73 
20 Xe 2X ee a 1a 


Then, from this sum, subtract the values of Steps 9, 10, and 11. 
.73 — .85 — .26 — 01 = .11 


Step 13. Computation of the cubic-component error term: Simply 
subtract the value obtained in the initial computation of Step 12 from that 
of Step 8. 

7.40 — .73 = 6.67 


Step 14. The df computations for the cubic components are the same 
as for the linear and quadratic components. In the present example, these 
are: 

df for withingubic == 743 

df for trials = 1 

df for trials by first factor = 1 

df for trials by second factor = 1 

df for trials by first by second factor = 1 
df for error bic = 24 


Step 15. Computation of the mean squares and F' ratios for the 
cubic component: These are computed in the same manner as for the 
linear and quadratic components. Again, table the results temporarily as 
follows. 


Source ss df ms F 
Withinguric 7.40 28 (not needed) — 
Trials 200, 1 135 1.25 

T X SE 26 1 .26 << 
T X Instr. .O1 1 .O1 << 
T X SE &X Instr. i 1 hl <1 
Erroreupic 6.67 24 .28 — 


Step 16. Final check for accuracy: Since each of the within-subjects 
sums of squares of the original analysis was broken into trend components, 
the sums of these components must equal (within rounding error) the 
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original values. In the present example: 


Source Linear Quadratic Cubic Sum Original 
Within subjects 1054.60 + 19.00 + 7.40 = 1081.00 1081 
Trials 782.58 + .O7 + .35 = 783.50 784 
T X SE 450 + .32 + .26 = 1.03 1 
T X Instr. 167.20 + 00 te Ole =) 167-21 167 
T X SE X Instr. 48.04 + .90 +o .lk-= 49.05 49 
Error within 56.33 + 17.21 + 6.67 = 80.21 80 


Step 17. Final tabling of the results: Although several procedures 
can be used, the following is probably used most often. 


Source ss df ms F Pp 
Within subjects 1081 84 — — — 
Trials 784 3 261.33 235.43 <.001 
Linear 782.58 1 782.58 333.01 <.001 
Quadratic OU 1 57 <i — 
Cubic .35 1 35 1.25 n.s 
Trials X SE 1 3 33 <i ——- 
Linear 45 1 45 <I — 
Quadratic .32 1 32 <@l 
Cubic 26 1 26 <1 
Trials X Instr. 167 3 55.67 50.15 <.001 
Linear 167.20 1 167.20 71.15 <.001 
Quadratic .00 1 .00 <a) = 
Cubic -01 1 .O1 <1 — 
Trials X SE X Instr. 49 3 16.33 14.71 <.001 
Linear 48.04 1 48.04 20.44 <.001 
Quadratic .90 1 90 1.25 n 
Cubic sill 1 Al <1 — 
Error within 80 72 ileal — — 
Linear 56.33 24 2.35 — —_ 
Quadratic 17.21 24 72 — — 
Cubic 6.67 24 .28 — — 


The significant linear components mean that the data points tend to 
lie along a straight line. 

If there had been significant quadratic components, it would have 
meant that there was a tendency for the data to follow quadratic functions 
(such as a parabola). Significant cubic components would have meant 
that there was a tendency for the data to follow an even more complex 
path with two inflections in the functions. The interpretation of linear, 
quadratic, and cubic components of interactions is very complex due to 
the fact that at least two sets of data points are involved in each. Only 
inspection of the data or additional analyses of each individual set of data 
points (using the same procedures just outlined) can give an indication as 
to which of the sets is contributing to the significant findings. 


PART 4 


Correlation and Related Topics 


The fourteen sections in this part present six rather different kinds of 
analyses. These six types are listed below, followed by a more detailed 
description of the different kinds of problems that can be handled with 
each analysis. This material should enable you to choose quickly the section 
that most clearly suits your individual needs. 


1. Pearson product-moment correlation (the common or usual corre- 
lation) 

2. Rank-order correlation, point-biserial correlation, and the corre- 

lation ratio (eta) 

Partial and multiple correlation 

Analyses of covariance 

Tests for reliability of measurement 

Significance tests for deciding whether two correlation coefficients 

are different in magnitude 


SE al 


Pearson Product-Moment Correlation (Section 4.1) 


Use the correlation coefficient described in Section 4.1 if your numbers 
represent amounts of some measurable quantity—such as height, age, IQ, 
grade points, test scores, etc. This analysis assumes that the two variables 
for which you have measures are linearly related. If you have ranked data 
or are reasonably sure that the variables are related in some complex curved 
way, use one of the correlation coefficients below. 
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Rank-Order Correlation, Point-Biserial Correlation, and eta (Sections 4.2, 
4.3, 4.4, and 4.5) 


If you have ranked data or if you wish to convert measures to ranks, 
use one of the rank-order correlations described in Sections 4.2 and 4.3. 
These analyses make no assumptions about the shape of the relationship 
between variables. 

If you have measures along one variable, such as grade points, and 
have another variable that is dichotomized, such as sex, use the point- 
biserial correlation described in Section 4.4. 

If you are fairly certain that the variables are related in some complex 
curved manner or if you have:already computed an F ratio, you can use 
the correlation ratio (eta), described in Section 4.5, to express the relation- 
ship between the two variables. 


Partial and Multiple Correlation (Sections 4.6, 4.7, and 4.8) 


If you have three variables and wish to know how highly two of them 
are related when the mutual relationships with the third variable are taken 
out, use the partial correlation described in either Section 4.6 or Section 4.7. 

If you have three variables and wish to know how highly two of them, 
taken together, are related to the third, use the multiple correlation de- 
scribed in Section 4.8. 


Covariance (Sections 4.9 and 4.10) 


When you wish to make the kinds of tests of significance described in 
Sections 2.1 and 2.2 (the completely randomized design and the two-factor 
factorial design) but cannot select random groups that are essentially 
equal, you must make statistical corrections for such differences. For 
example, if one group is composed of grade-school children and another 
of high-school students and you wish to measure the amount of verbal 
material learned in a certain interval of time, you would reasonably expect 
the groups to differ initially by a large amount because of their different 
levels of education. The analyses of covariance, described in Sections 4.9 
and 4.10, provide a technique whereby you can equate the two groups 
before training begins. 


Reliability of Measurement (Sections 4.11 and 4.12) 


Whenever measures are gathered by some sort of testing, the validity 
of the measures depends upon the quality of the test being used. The 
tests for the reliability of measurement involve particular interpretations 
of a correlation coefficient. Sections 4.11 and 4.12 consider the topic of 
reliability of measurement. 
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Significance Tests of Differences Between Correlations (Sections 4.13 and 4.14) 


Each correlation coefficient is regarded as being either (1) indicative 
of a real relationship or (2) due to chance variation. Each of Sections 4.1 
through 4.8 presents a test to help you decide which of the two cases is 
most likely for a particular correlation value. However, it is often desirable 
to know whether two correlation coefficients differ by more than would be 
expected by chance. Sections 4.13 and 4.14 present tests to help evaluate 
differences between correlation values. If the two correlation coefficients 
are computed using completely different groups of people (that is, if the 
correlations are independent), use the test presented in Section 4.13. If the 
correlation values have been computed using the same people (that is, if 
the correlations are dependent), use the test presented in Section 4.14. 


In this part, computational formulas will again be presented in those 
instances where a complete analysis can be shown by a single formula or 
where a standard set of terms and symbols are used in nearly all textbooks. 


SECTION 4.1 
Pearson Product-Moment Correlation 


The Pearson product-moment correlation (7) is used to determine if 
there is a relationship between two sets of paired numbers. Generally, the 
paired numbers are either (1) two different measures on each of several 
objects or persons or (2) one measure on each of several pairs of objects 
or people where the pairing is based on some natural relationship, such as 


father to son, or on some initial matching according to one specific variable, 
such as IQ score. 


EXAMPLE 


Assume that an experimenter wishes to determine whether there is a 
relationship between the grade point averages (GPAs) and the scores on a 
reading-comprehension test of fifteen college freshmen. 
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The basic computational formula for the Pearson product-moment 
correlation is 


east PRE Qa OW Gn OuNg 
VIN OX? — (OX) IN oY? — OLY) 


where N = number of pairs of scores 
>-XY = sum of the products of the paired scores 
>-X = sum of scores on one variable 
>°Y = sum of scores on the other variable 
>> X? = sum of the squared scores on the X variable 
>Y? = sum of the squared scores on the Y variable 


Step 1. The scores must be paired in some meaningful way in order 
to use the Pearson r. In the present example, the two different scores— 
reading comprehension and grade point average—are paired and recorded 
for each of the fifteen students. 


Reading Score Freshman GPA 


Student (X) (Y) 
Si 38 2.1 
S2 54 2.9 
S3 43 3.0 
S4 45 2.3 
Ss 50 2.6 
So 61 Sarl 
S7 57 Baz 
Ss 25 eS 
So 36 1.8 
Sio 39 2.5 
Su 48 3.4 
Sy 46 2.6 
S13 44 2.4 
S14 39 2.5 
Sis 48 3.0 


Step 2. Multiply the two numbers in each pair; then add the products. 
(38 X 2.1) + (54 XK 2.9) + +++ + (48 X 3.3) = 1846.1 


Step 3. Multiply the number obtained in Step 2 by N, the number 
of paired scores (15 in this example). 


1846.1 X 15 = 27,691.5 


Step 4. Square each number in the first column, and add the squared 
values. (Note: As these squares are accumulated—that is, added—by the 
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calculating machine, the value of Step 6 will be accumulating in the upper 
dial.) 
38? + 542 + +--+ + 48? = 31,327 


Step 5. Multiply the sum of Step 4 by the number of paired scores 
(N = 15 in this example). 


31,327 X 15 = 469,905 


Step 6. Add all the scores in the first column (in this example, the 
reading-comprehension scores). 


33 4 SA ee-  8 =°673 
Step 7. Square the value obtained in Step 6. 
673? = 452,929 


Step 8. Square each number in the second column, and add the 
squared values. (Note: The value of Step 10 can be obtained at the same 
time, as explained in Step 4.) 


2h 2.0% mee oe = 110.2 


Step 9. Multiply the result of Step 8 by the number of paired scores 
(N = 15 in this example). 


110.2 X 15 = 1653 


Step 10. Add all the scores in the second column (in this example, 
the freshman GPAs). 


2:0 2.9. -- ++ 3.3 = 39.6 
Step 11. Square the value obtained in Step 10. 
39.6? = 1568.16 
Step 12. Multiply the final value of Step 6 by that of Step 10. 
673 X 39.6 = 26,650.8 


Step 13. The numerator of r is now computed by subtracting the 
value obtained in Step 12 from that obtained in Step 3. Be careful to note 
whether the answer is positive or negative. 


27,691.5 — 26,650.8 = +1040.7 
Step 14. Subtract the value of Step 7 from that of Step 5. 
469,905 — 452,929 = 16,976 


Note: If the variance of these first-column scores is desired, divide the result 
of Step 14 by N?, 1.e., 16,976/15? = 16,976/225 = 75.45. Or if an estimate 
of the variance of the population from which these scores were drawn is 
desired, divide by N(N — 1), i.e., 16,976/[15(15 — 1)] = 16,976/210 = 
80.84. 
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Step 15. Subtract the final value of Step 11 from that of Step 9. 
1653 — 1568.16 = 84.84 


Note: The variance of these second-column scores can be obtained by 

dividing this result by N?, i.e., 84.84/15? = 84.84/225 = .38. For the esti- 

mate of the population variance, divide by N(N — 1), i.e., 84.84/210 = .40. 
Step 16. Multiply the result of Step 14 by the result of Step 15. 


16,976 X 84.84 = 1,440,243.84 


Step 17. Take the square root of the result of Step 16. 


V 1,440,243.84 = 1200.1 


Step 18. Divide the value of Step 13 by that of Step 17. This yields 
the value of the Pearson product-moment correlation. 


+1040.7 
Pena Bieta hie 


12001 7°" 


SUPPLEMENT 


Testing the significance of r: Two different procedures are used to 
test the hypothesis that r = 0. If N (the number of pairs) is 30 or larger, 
a critical-ratio z-test can easily be done. If N is smaller than 30, a slightly 
more complicated t-test should be done. 

Step 19. If N is 30 or larger, compute z = r>/N — 1. For example, 
suppose r = —.56 and N = 37. Then, 


z= (—.56) 0/37 — 1 = (—.56) 0/36 = —.56 X 6 = —3.36 


If z is greater than +1.96, then r is significant at the .05 level using a two- 
tailed test (see Appendix A). 

Step 20. If N is smaller than 30, compute t = rv/(N — 2)/(1 — 7°). 
Using the value of r from Step 18 and the value of N used to compute that r, 
we have r = +.87 and N = 15. Thus, 


eee: 13 
t= (+87) | = 874]; — 87+/54.16 


= 87 X 7.36 = +6.40 


The degrees of freedom for this ¢ are N — 2. 
df=15—2=13 


With 13 degrees of freedom, a ¢ value larger than +2.16 (see Appendix B) 
is significant at the .05 level when a two-tailed test is used. 

Note: Several critical values of r are given in Appendix F for various 
degrees of freedom. 
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SECTION 4.2 


Spearman Rank-Order Correlation (rho) 


Spearman’s rho is used when an experimenter wishes to determine 
whether two sets of rank-ordered data are related. 


EXAMPLE 


The experimenter first asked an experienced teacher to rank twenty 
children in her class according to what she believed their intelligence to be. 
Then the children were tested and their actual Wechsler IQ scores obtained. 
The data were as follows. 


Teacher’s IQ 

Child Ranking Score 
A 1 116 
B 2 111 
C 3 97 
D 4 122 
E 5 116 
F 6 105 
G 7 108 
H 8 95 
J 9 124 
J 10 98 
K 11 116 
L 12 109 
M 13 103 
N 14 103 
O 15 96 
e 16 90 
Q LY 134 
R 18 87 
8 19 96 
at 20 91 


The following formula for rho (p) describes the computational pro- 
cedures. 


6>\D? 


eee 
or N(N? — 1) 


where D = difference score between each X and Y pair 
= number of pairs of scores 


= 
| 
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Step 1. Rank the IQ scores so that both variables are ranked. 

Note: When two children have the same IQ score, the same rank is 
given to each. But notice that the rank given is the mean value of the two 
ranks for the two tied scores. For example, Child M and Child N both 
have IQ scores of 103. These scores should fall into ranks 11 and 12. But 
since both children have the same IQ score, both are ranked as 11.5 and 
the next score (Child J, with an IQ score of 98) is ranked as 13. 


Teacher’s IQ Rank on the 


Child Ranking __ Basis of Test Score 
A 1 5 
B 2 7 
Cc 3 14 
D 4 3 
E 5 5 
F 6 10 
G 7 9 
H 8 17 
I 9 2 
J 10 13 
Kk 11 5 
L 12 8 
M 13 ih} 
N 14 JS 
O 15 15.5 
1B: 16 19 
Q 17 1 
R 18 20 
Ss) 19 15.5 
40 20 18 


Step 2. Compute the difference between the two ranks for each child. 
The resulting value is called the D value. List these values in a column, 
making sure to note whether they are positive or negative. 


Child D Value 


A —4 (1-5) 
B —5 Ger) 
C wil. = (3-14) 
D +1 (4-3) 
E 0 (5-5) 
F a4 (6-10) 
G —2 (7-9) 
H —9 (8-17) 
I +7 (9-2) 
J = ates 
K +6 (11-5) 
bi 


ug) 6(12=8) 
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Child D Value 


“ELS. (S415) 
42.5 (14-11.5) 
—0.5 (15-15.5) 
3 wh 616-19) 
£16 fl) 
—2 (18-20) 
+3.5 (19-15.5) 
+2 (20-18) 


HAHOVOAS 


Step 3. Square all the D values from Step 2, and add all the squared 
values. : 


(—42) + (5%) + +++ + 2 = 668 


Step 4. Multiply the result of Step 3 by the number 6. (Note: The 
number 6 is always used, regardless of the number of ranks, etc., involved.) 


668 X 6 = 4008 
Step 5. Compute N(N? — 1). (In our example N = 20.) 
20(20? — 1) = 20(400 — 1) = 20(399) = 7980 
Step 6. Divide the result of Step 4 by the result of Step 5. 


4008 _ ea 

7980 

Step 7. Subtract the final value of Step 6 from the number 1. (Note: 

The number 1 is also always used.) This yields the value of Spearman’s rho. 
Be careful to record whether it is positive or negative. 


rho = 1 — .50 = +.50 


SUPPLEMENT 


Testing the significance of rho: Two different procedures are needed 
to test the hypothesis that rho = 0. If N (the number of ranks) is 30 or 
larger, a critical-ratio z-test can easily be done. If N is between 10 and 30, 
a slightly more complicated é-test should be done. No test is presented 
here for the significance of rho where N is less than 10 since it is rare that 
so few ranks would be considered. 

Step 8. When N is 30 or greater, compute z = rhor~/N — 1. For 
example, suppose rho = —.21 and N = 50. Then, 


2= (—.21)vV/50 — 1 = (—.21) 49 = —.21 X 7 = —1.47 


If z is greater than +£1.96, then rho is significant at the .05 level using a 
two-tailed test (see Appendix A). 
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Step 9. When N is between 10 and 30, compute 
eeerho Bia ee Ss 
1 — rho? 


Using the value of rho from Step 7 above and the value of N used to com- 
pute that rho, we have rho = +.50 and N = 20. Thus, 


20 — 2 ahs 18 
se cia \Pa2, tenn \; - 75 
tot) 1 — rho? Rio) 1 — 25 0) 75 


= (+.50) 7/24 = +.50 X 4.9 = 42.45 
The degrees of freedom for this t are N — 2. Thus, 


df = 20 —2 = 18 


With 18 degrees of freedom, a ¢ value larger than +2.10 (see Appendix B) 
is significant at the .05 level when a two-tailed test is used. 


SECTION 4.3 
Kendall Rank-Order Correlation (tau) 


Kendall’s tau is sometimes used in place of Spearman’s rho, which was 
presented in Section 4.2. If you have a pair of ranks for each of several 
individuals, the tau statistic can be computed to express the degree of 
relationship between the ranks. Its significance can be tested as follows. 


EXAMPLE 


Assume that an experimenter wishes to determine the degree of re- 
lationship between the ratings of two judges on ten contestants in a beauty 
contest. The measures recorded represent the ranks given to the con- 
testants by each of the judges. 

The usual formula for taw when there are no tied ranks is 


| ee) 
2N(N — 1) 


£ 


tau = 
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where P = total number of higher ranks 
Q = total number of lower ranks 
N = number of pairs of ranks 


(Note: See the following for the explanation of “higher” and “Jower.”’) 

A more general computation, covering a case where some ranks are 
tied, is presented here. Steps 7 through 12 show how to correct for the tied 
ranks. 

Step 1. Table the data as follows. In computing tau, always arrange 
the first column of ranks so that they range from the lowest to the highest 
as you go down the column. 


Ranking by Ranking by 
Contestant Judge A Judge B 
A 1 3 
B 2 5 
Cc 3.5 PS 
D 3.5 4 
E 5 Lo 
F 6 6 
G 8 8 
H 8 7 
I 8 10 
J 10 9 


Step 2. The ranks in the first column run from the lowest to the 
highest. The ranks in the second column are “mixed up.’”’ We must de- 
termine the extent of the “mix-up” in Column 2. In order to do so, count 
the number of ranks in Column 2 that are higher than that for Contestant 
A—1.e., the number of ranks that are higher in numerical value than the 
number 3. In this example, only the two 1.5’s are lower than 3; therefore 
there are seven numbers higher than 3. 


No. of higher ranks = 7 
Then, count the number of ranks that are lower than 3. 
No. of lower ranks = 2 


Step 3. Next, count the number of ranks in Column 2 that are higher 
than the rank for Contestant B—i.e., the number of ranks higher than 5. 
In this example, 6, 8, 7, 10, and 9 are higher than 5. Thus, 


No. of higher ranks = 5 


Then count the number of ranks lower than 5. Do not include ranks that 
have already been considered (Contestant A). With the ranking for A 
excluded, 


No. of lower ranks = 3 
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Step 4. Now count the number of ranks that are higher than the 
rank for Contestant C—i.e., the number of ranks higher than 1.5. All 
ranks except the other 1.5 are higher, but ties are not counted and we 
have already taken care of numbers 3 and 5 for Contestants A and B. 
Thus, 


No. of higher ranks = 6 
Now count the number of ranks lower than 1.5. 
No. of lower ranks = 0 


Step 5. Continue counting both the number of ranks higher and 
the number of ranks lower than the one under consideration for all the rest 
of the ranks in Column 2. Table the results as follows. (Note: The values 
for the bottom contestant are both zero since no ranks appear below 
them. ) 


No. of Higher No. of Lower 


Contestant Ranks Ranks 
A 7 2 
B 5 3 
C 6 0 
D 5 1 
E 5 0) 
F 4 0 
G 2 1 
H 2 0 
I 0 1 
J 0 0 


Step 6. Add the numbers in each of the columns in Step 5. 


7+5+ +--+ +0 = 36 = sum of Column 1 (higher ranks) 
2+3+---+0= 8 = sum of Column 2 (lower ranks) 


Then, subtract the sum of Column 2 from the sum of Column 1. Be careful 
to record whether the result is positive or negative. 


36 — 8 = +28 


Step 7. Go to the table in Step 1 and count the number of ranks 
that are tied in the first column (the ranks assigned by Judge A). Cate- 
gorize each tie as being a set of two, three, four, etc., according to the 
number of contestants in that tie. Then, compute «(z — 1) for each tie, 
where x is the number of contestants tied for that place—e.g., 2(2 — 1) = 
2(1) = 2;5(5 — 1) = 5(4) = 20; etc. Add these products, and divide by 2. 
(Note: The number 2 is always used.) In this example, Contestants C and 
D tied for the third and fourth positions (both were assigned to the rank 
of 3.5) and Contestants G, H, and I tied for the seventh, eighth, and 
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ninth places (all were assigned to the rank of 8). In this example, then, 


there is one set of two and one set of three. Thus, 


2(2—1)+3(8—1) 2(1)+.3(2) 2+6 8 
2 2 2 ree. 4G? 


=4 


Step 8. Repeat all the computations of Step 7 using the ranks in the 
second column of Step 1 (the ranks assigned by Judge B). Notice that 
Contestants C and E are tied at a rank of 1.5. Thus, we have one set of 
two, so 


22 — 1), 20) 2 
” van a lbe, 


=| 
Step 9. Compute [N(N — 1) ]/2, where N refers to the total number 
of ranks in each column (10 in this example). 


N(N—1) _10(10—1) _ 10(9) _ 90 
2 » 2 oe 


bo 
bo 


Step 10. Subtract the result of Step 7 from the result of Step 9. 
45 —4 = 41 
Step 11. Subtract the result of Step 8 from the result of Step 9. 
45 —1= 44 
Step 12. Multiply the result of Step 10 by the result of Step 11. 
41 X 44 = 1804 
Then, take the square root of the product. 
/1804 = 42.474 


Step 13. Divide the result of Step 6 by the result of Step 12. This 
yields the value of Kendall’s taw. 


SUPPLEMENT 


Testing the significance of tau (i.e., the hypothesis that taw = 0): 
When there are 10 or more ranks and when the number of tied ranks is 
not too great, the following significance test will yield approximate values. 

Step 14. Compute [V(N — 1)(2N + 5)]/18 where WN is the total 
number of ranks in each column of Step 1 (10 in this example). 


10(10 — 1)[2(10) +5] _ 10(9)(20 +5) — 90(25) _ 2250 ee 
18 = 18 a Oh ee oe 
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Step 15. Take the square root of the result of Step 14. 
4/125 =°11.18 


Step 16. Divide the result of Step 6 by the answer of Step 15. This 
yields a z statistic. 


Bs Beate = +2.50 
BSAC aaa 
If the result of Step 16 is larger than +1.96 (see Appendix A), then tau 
is significant at the .05 level using a two-tailed test. 


SECTION 4.4 
Point-Biserial Correlation 


The point-biserial correlation is used when a coefficient of relationship 
is desired between one measure that is continuous and another that is 
dichotomous. 


EXAMPLE 


Assume that an experimenter wishes to determine the relationship 
between scores on a certain college entrance examination and whether 
the student obtained a grade point average of C or better during the 
freshman year. Twelve students are picked at random and their entrance- 
examination scores and their course grades are recorded. 

The continuous variable in this example is the array of scores on the 
college entrance examination. The dichotomous variable is the grade point 
category, which is determined by whether the student got (1) a C or better 
or (2) lower than a C. The number | represents the grade of each person 
who obtained a C or better. A cipher, 0, represents the grade of those who 
got lower than a C. 

The formula for the point-biserial correlation is 


on vs = Y; NiNo 
Leena N(N — 1) 
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where Y, = the mean of the values of the continuous variable for persons 

in dichotomous category 1 

the mean of the values of the continuous variable for persons 

in dichotomous category 0 

N, = the number of persons in dichotomous category 1 

Ny = the number of persons in dichotomous category 0 

s, = the estimated standard deviation of the population of con- 
tinuous-variable values from which the sample was taken 

N = the total number of persons in the sample (Ni + No) 


Yo 


I 


The formula for the estimated standard deviation of the population is 


ere oe 


Nia te. SNCW =215 


Sy 


Step 1. Table the data as follows. 


College-Entrance- 


Examination Score GPA 
Student ) Category 
A 104 1 
B 82 0 
Cc 92 1 
D 76 0 
E 101 i 
F 111 1 
G 98 1 
H 85 0 
I 88 1 
J 67 0 
Kk 106 1 
L 95 0 


Step 2. Make a list of all those examination scores paired with 


the GPA category 1 and a list of all those scores paired with the GPA 
category 0. 


Yi Scores Yo Scores 
(Paired with GPA 1) (Paired with GPA 0) 


104 82 
92 76 

101 85 

111 67 
98 95 
88 
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Step 3. Compute the means of the two groups of scores. 


= 104 + 92+ ---+ 106 0 
pee lens s + aa ne 


a 82+ 76+ ---+9 40 
oe Ze _ £8 SP = 1 


Step 4. Perform the subtraction Y; — Yo, noting and recording the 
sign of the result. 
100 — 81 = +19 


Step 5. Obtain ~/(NiNo)/[N(N — 1) ]. (In our example, N, = 7, 
No = 5, and N = Ni + No = 1s) 


[OG) _ [85 _ ae 
12(11) Be ae = V/ 265 = .o15 


Step 6. Square all the examination scores of Step 1, and add the 
squares. (Note: Steps 6 and 8 can be done at the same time if you are using 
a calculating machine. ) 


104? + 82? + --- + 95% = 103,625 


Step 7. Multiply the value obtained in Step 6 by N (12 in our 
example). 


103,625 XK 12 = 1,243,500 

Step 8. Add all the examination scores. 

104 + 82+ +--+ + 95 = 1105 
Step 9. Square the value obtained in Step 8. 

1105? = 1,221,025 

Step 10. Subtract the result of Step 9 from the result of Step 7. 

1,243,500 — 1,221,025 = 22,475 
Step 11. Divide the result of Step 10 by N(N — 1). 


22,475 22,475 — 22,475 


= = = 170.265 
N(N — 1) 12(11) 132 


Step 12. Take the square root of the result of Step 11. 
+/170.265 = 13.05 
Step 13. Divide the result of Step 4 by the result of Step 12. 


19 
——— = +1.456 
at 13.05 v 
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Step 14. Multiply the result of Step 13 by the result of Step 5. This 
yields the value of rp». (We see from Step 4 that the value will be posi- 
tive when Y, is larger than Yo.) 


re = +1.456 X 515 = +.75 


SUPPLEMENT 


Testing the significance of r,,: The hypothesis that r,, = 0 can be 


tested by the t-test 
; |N —2 
aN tes? 


which has N — 2 degrees of freedom. In our example, rp, = +.75 and 
N = 12. Thus, 


12-2 10 RS. 
= eiire) «| sd ae = cripsjqion Mi = (+.75) 438 


= (+.75) VV 22.831 = (+.75) (4.78) = +3.58 


With N — 2 = 12 — 2 = 10 degrees of freedom, a ¢ value larger than 
+2.23 is significant at the .05 level using a two-tailed test (see Appendix B). 


SECTION 4.5 
The Correlation Ratio (eta) 


As a measure of relationship between two variables, eta can be useful 
in two different situations: (1) when the relationship is sufficiently non- 
linear to make you hesitant about using the Pearson correlation or (2) 
when the experiment involves independent and dependent measures and 
you wish to know the degree of their relationship. 

Step 1. Eta is most clearly defined as 


DO between groups 


SStotal 


eta = 
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where SShetween and SStora1 are sums of squares that are computed in a typical 
analysis of variance. For the purposes of illustration, we will use the SS, 
and SS; from the last step of Section 2.1. 


SSp = 567 SS; = 1132 


Step 2. From these values we compute 


567 
t = — = z = 4 
eta Nkere V .50 7A 


This value of eta gives a rough indication of the correlation between the 
independent and dependent variables in the experiment discussed in Section 
2h. 

Step 3. In order to compute eta from raw data, turn to Section 2.1 
and follow all the steps for the completely randomized design. To test the 
eta for significance, complete the F-test for significance of the group means 
as given in Section 2.1. The results of that test are also the results of a 
significance test of eta. For the example above, we see that eta is judged to 
be different from zero. 


R= MShetween rab 189 
MSvyithin 12.84 


=14.71 df = 3/44 


Regardless of which use of efa (as presented at the beginning of this 
section) you wish to make, compute the sums of squares according to the 
steps presented in Section 2.1; then follow the directions in the present 
section. 


SUPPLEMENT 


It is sometimes important that one know the eta for research reported 
in a publication. The relationship between a particular independent variable 
and the dependent measure used as a criterion can be found if the F ratio 
and the degrees of freedom are reported. The procedure for computing eta 
from a given F value is as follows. We will use the data presented in Section 
2.7 for the purposes of illustration. 

Step 1. Obtain the F of interest (here, the F for trials) and the 
appropriate degrees of freedom. 


F = 52.46 df = 2/60 
Step 2. Multiply the F value of Step 1 by the numerator df. 
52.46 X 2 = 104.92 
Step 3. Add the result of Step 2 to the denominator df from Step 1. 
104.92 + 60 = 164.92 
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Step 4. Divide the result of Step 2 by the result of Step 3. This 
yields the square of eta. 


104.92 _ 
164.92 ~ 
Step 5. Take the square root of the final value of Step 4. 


eta = ~/.64 = .80 


This value of eta indicates the degree of relationship between the trials 
variable and the dependent variable, which is number of correct responses 
per trial in the verbal-learning situation. 


SECTION 4.6 
Partial Correlation: Three Variables 


Partial correlation is used when you have three sets of measures that 
are related and you wish to find the relationship between any two when the 
relationship effect of the third has been taken out of both variables. 


EXAMPLE 


Suppose you have measures of (a) incomes of a group of fathers, 
(b) incomes of their eldest sons, and (c) number of years of formal education 
of the sons. A correlation of +.60 between incomes of fathers and sons 
might be interpreted as being indicative that money-making characteristics 
run in families. However, an observer might argue that the most probable 
contributor to the similarity in incomes of fathers and sons is level of 
education. A partial correlation between incomes of fathers and sons with 
the effect of education “partialed’”’ out would help solve the controversy. 

The notation for partial correlation is rac, which is read as ‘‘the partial 
correlation between variables a and b with the relational effects of c taken 
out.”’ The formula for partial correlation is 


Tab — Yachbe 


Tab.c = ‘<A = 8 ar a: mo 
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Step 1. Compute the simple correlation between each of the three 
possible pairs of measures—ra, Tac, and r-. To do this, follow the steps 
provided in Section 4.1 for each of the three correlation coefficients needed. 
Let us assume that the three correlations for this example turned out to be 


Tob = +.60 Tac = +.70 Toe = +.80 
Step 2. Compute the partial correlation between a and b. 


.60 — (.70) (.80) 60°" 756 


PO Ter TENT Main OT = TST 


+04 = 4.04, -.04 
V/.51 V36 ~ (.714)(.60) 428 


Thus, the correlation ra, = +.60 is reduced to ra. = +.09 when the 
mutual relationships of the variables with c are partialed out. These 
data suggest that the hypothesis that money-making ability is hereditary 
is false and that the reason fathers and sons tend to have similar incomes 
is that they tend to have similar levels of education. 

Step 3. The other two partial correlations could be computed in a 
similar manner if desired. 


= +.09 


— Tac — Tabled as 10 — (.60) (.80) 
Le a tay rae A Weng ome eae a 4 Wee 
te CAR Oh ag 
‘A Tre — Toalca _ 80 — (.70) (.60) 
Ae ae la oratin len/ = 10a 1 00 
558) 6 Aye 
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SECTION 4.7 


Partial Rank-Order Correlation (Using Kendall’s tau) 


The tau statistics of Section 4.3 may be extended to the case of partial 
correlation in either of two cases: (1) when there are no tied ranks or (2) 
when there are tied ranks but the rank-order correlations are expected to 
yield only rough indications of true values. No significance test for partial 
tau can be presented since the sampling distribution is unknown. 


EXAMPLE 


Suppose that a judge has rank ordered fifteen individuals on the basis 
of IQ, personality, and poise. In this case, the experimenter wishes to 
determine the correlation between each possible pair of rankings when the 
effects of the third have been taken out. The data might appear as follows. 


Ranking 1 Ranking 2 Ranking 3 
Subject (IQ) (Personality) (Poise) 
Si 1 3 1 
S2 2 5 4 
Sis 15 13 12 


Step 1. First, go to Section 4.3 and compute the tau value for each of 
the three possible pairs of rankings—1 with 2 (tau), 1 with 3 (tau), and 
2 with 3 (tawz3). For this example, suppose 


tauiy = +.50 tau;3 = +.60 taur; = +.80 


Step 2. Compute the partial correlation of 1 with 2, partialing out 
the relationships with 3. 


tauy = tauy3 tauo3 = 50 ins (.60) (.80) 
V1 — tam? V1 — taues? ~W11 — 60? ~/1 — .80? 


tauy.3 = 


ny 50 — .48 8 EE 02 28) ieee Ge 
V1 — 36/1 — 64 7644/36 —_(.80) (.60) 
_ +.02 


ia +.04 
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Step 3. In a similar manner, compute the partial correlation of 2 
with 3, partialing out the relationships with 1. 


oe ie taU3 a. taue, tausi - 80 — (.50) (.60) 
: V1 a taue;” V 1— taus;” - V1 — 50? V/1 — .60? 
" .80 — .30 - + .50 om +.50 
V1 — .25V/1— 36 VW.75 v.64 —_(.866) (.80) 
+.50 
= ——— = =F 572 
.693 ‘' 


Step 4. Finally, compute the partial correlation of 1 with 3, partialing 
out the relationships with 2. 


ee taui3 — laure tare; De .60 — (.50) (.80) 
’ V1 — tary” VJ/1 — taur3* V1 — .50? V1 — .80? 
¥ 60 — 40 +20 20 
V1 — 25/1 — 64 V.75 36 (.866) (.60) 
+ .20 
SSS hE 
.520 2 


SECTION 4.8 
Multiple Correlation: Three Variables 


Multiple correlation is used when you wish to determine the relation- 
ship of one set of numbers (measures on a variable) with two other sets 
of numbers. 


EXAMPLE 


In a typical multiple-correlation situation, the first set of numbers 
represents measures on a criterion variable—in this example, freshman 
grade point average—and the other two sets of numbers are measures on 
predictors—here, high-school grades and _college-entrance-examination 
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scores. The multiple-correlation coefficient between the criterion variable 
and the two predictor variables will give an indication of the degree to 
which the predictors, taken together, actually predict. 

Step 1. If you have measures on two predictor variables and one 
criterion variable, go to Section 4.1 and compute the three simple corre- 
lation coefficients according to the instructions there. Let’s abbreviate the 
three variables as: 


1 = the criterion variable: freshman grade point average (GPA) 
= the first predictor: high-school grades 
3 = the second predictor: entrance-examination scores 


The first correlation coefficient, ri, is between GPA and high-school 
grades; 733 is between GPA and examination scores; and r2; is between 
high-school grades and examination scores. For the purposes of illustration, 
assume that the simple correlations in this case turned out to be 


T12 = + .60 N13 = +.50 T23 = +.70 


Step 2. The multiple correlation of 1 with 2 and 3 is given by 


M12” + 113” — 2213723 
Riss = 


to ee 


Step 3. Simply plug the values of the simple correlations in at the 
right spots, and carry out the operations. 


ae + .50? — 2(.60) (.50) (.70) 
Ri .23 _ 
1 &.763 


a as + .25 — 1.20(.50) (.70) _ ie — 1.20(.35) 
1— 49 aj 51 


pp = 
oN Shoe 


V 373 = .61 


This is the value of the multiple correlation between the criterion variable 
and the two predictor variables. The correlation between high-school grades 
and freshman GPA was .60, and the correlation between the entrance- 
examination scores and freshman GPA was .50. By combining the high- 
school grades with the entrance-examination scores, the multiple corre- 
lation with freshman GPA was raised to .61. Thus, the combination of 
predictors produced a higher correlation with the criterion variable than 
either predictor taken separately. 

Concerning the size of the correlation between the predictor variables 
and their joint correlation with the criterion: If the simple correlations 
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between each of the predictors and the criterion remain unchanged, the 
value of R, the multiple correlation, will increase as the correlation between 
the predictors becomes smaller than .65 and the value of R will decrease 
as the correlation between predictors increases above .65. In other words, 
the more independent of each other the predictors are, the greater their 
value in jointly predicting the criterion, provided the simple correlations 
between each predictor and the criterion remain constant. 

Computation of the multiple-correlation coefficient becomes much 
more complicated if there are more than two predictor variables. A pro- 
cedure such as the Doolittle solution, as explained by McNemar,! can be 
used or, probably better, a competent computer programer can find a 
ready-made program that will do the job quickly and accurately. 


SECTION 4.9 
Simple Analysis of Covariance: One Treatment Variable 


When experimental control of an important variable—such as age or 
IQ—is impossible or impractical, statistical control is possible by use of 
a covariance analysis. This section presents the procedures for such an 
analysis when there is only one treatment variable. 


EXAMPLE 


In order to make a decision concerning future equipment needs, an 
elementary-school principal designed the following experiment to evaluate 
three different methods of teaching spelling. Eighteen first-grade children 
were given a vocabulary test (the control measure) to determine their 
verbal ability before the program was begun. The X values below represent 
these test scores. The three different teaching methods were used for three 
months, and then a standard spelling test was given. The Y values represent 
these criterion spelling scores. 


1Q. McNemar. Psychological Statistics, 3rd ed. New York: John Wiley & Sons, Inc., 1962. Chapter 11, 
pp. 180-184. 
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Step 1. Table the data as follows. 


Teaching Method 1 ‘Teaching Method 2 Teaching Method 3 


Student X yi Student x IG Student x yg 
A 32 62 G AA 72 M 38 95 
B 46 66 H 24 85 N 45 88 
Cc 27 64 ii 18 61 O 52 104 
D 35 48 J 32 87 EF 48 86 
E 31 51 K 35 69 Q 41 72 
F 40 74 L 26 74 R 37 63 


Step 2. Add the scores in each column. 


Method 1 Method 2 Method 3 
xX “g xX Yr. xX Y 
32 62 21 72 38 95 
46 66 24 85 45 88 
Sums: 211 365 156 448 261 508 


Step 3. Square all the numbers in the X columns (Step 1), and add 
the squared values. 


oat 463? 3 a 2 ee -F 26" 
+ 38? + 45? + --- + 37? = 23,448 
Step 4. Add the sums of the X columns (Step 2). 
211 + 156 + 261 = 628 
Step 5. Square the result of Step 4, and divide by the number of X 
values (18 in this example). 
628? 394,384 
Bay) WHS 


= 21,910.222 


Step 6. Subtract the result of Step 5 from the result of Step 3. 
23,448 — 21,910.222 = 1537.778 


Step 7. Square the three sums of the X columns (Step 2) and add 
the squares; then divide by the number of scores composing each sum 
(6 in this example). 


211? + 156? + 261? 136,978 
6 = ~"G 


= 22,829.667 
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Step 8. Subtract the result of Step 5 from the result of Step 7. 
22,829.667 — 21,910.222 = 919.445 
Step 9. Subtract the value of Step 8 from that of Step 6. 
1537.778 — 919.445 = 618.333 


Step 10. Square all the numbers in the Y columns (Step 1), and 
add the squares. 


62? + 66? + +++ + 742 + 722 4+ 8524 +--+ + 742 
+95? + 88? + +++ + 63? = 100,747 
Step 11. Add the sums of the Y columns (Step 2). 
365 + 448 + 508 = 1321 


Step 12. Square the result of Step 11, and divide by the number of 
Y values (18 in this example). 
ByA = 1,745,041 
ig is 


= 96,946.722 


Step 13. Subtract the result of Step 12 from the result of Step 10. 
100,747 — 96,946.722 = 3800.278 


Step 14. Square the three sums of the Y columns (Step 2), and 
add the squares; then divide by the number of scores composing each sum 
(6 in this example). 


365? + 448? + 508? 
6 


Step 15. Subtract the result of Step 12 from the result of Step 14. 
98,665.500 — 96,946.722 = 1718.778 


= 98,665.500 


Step 16. Subtract the final value of Step 15 from that of Step 13. 
3800.278 — 1718.778 = 2081.500 


Step 17. Multiply each X score by its paired Y score (see Step 1), 
and add all the products. 


(32 X 62) + (46 X 66) +--+ + (37 X 63) = 47,131 


_ Step 18. Multiply the result of Step 4 by the result of Step 11, 
and divide by the number of XY pairs (18 in this example). 


628 X 1321 829,588 
at att 


= 46,088.222 
18 
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Step 19. Subtract the final value of Step 18 from that of Step 17. 
47,131 — 46,088.222 = 1042.778 


Step 20. Multiply each X sum in Step 2 by its paired Y sum, and 
add the three products; then divide by the number of pairs under each 
method (6 in this example). 


(211 X 365) + (156 X 448) + (261 X 508) 2 279,491 
6 


Step 21. Subtract the result of Step 18 from the result of Step 20. 
46,581.833 — 46,088.222 = 493.611 
Step 22. Subtract the value of Step 21 from that of Step 19. 
1042.778 — 493.611 = 549.167 


= 46,581.833 


Step 23. Square the result of Step 19, and divide by the result of 
Step 6. 
1042.778? — 1,087,385.957 


= = 707.115 
1537.778 1537.778 


Step 24. Subtract the result of Step 23 from the result of Step 13. 
3800.278 — 707.115 = 3093.163 


Step 25. Square the result of Step 22, and divide by the result of 
Step 9. 


549.167? 301,584.394 


=- = 487.7 
618.333 618.333 5 a 


Step 26. Subtract the result of Step 25 from the result of Step 16. 
2081.500 — 487.738 = 1593.762 


Step 27. Divide the value of Step 26 by the number of degrees of 
freedom for the adjusted within-groups measures. The degrees of freedom 
will always be N — a — 1, where N is the total number of XY pairs (18 
in our example) and a is the number of different experimental groups (3 in 
our example, corresponding to the three methods of teaching). 


1593.762 _ _1593.762 __ 1593.762 
Nit gia Aig 6 1. Ores 


= 113.840 


Step 28. Subtract the value of Step 26 from that of Step 24. 
3093.163 — 1593.762 = 1499.401 


Step 29. Divide the result of Step 28 by the number of degrees of 
freedom for the adjusted between-groups measures. This degrees-of-freedom 
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value will always be a — 1, where a is the number of different experimental 
groups (3 in our example). 


1499.401 _ 1499.401 __1499.401 
el oral Whe 2 


= 749.700 


- Step 30. Compute the F ratio by dividing the result of Step 29 by 
the result of Step 27. 


This F has df = (a — 1)/(N — a — 1). (This equals 2/14 in our example. ) 
From Appendix D it is seen that with df = 2/14, an F ratio larger than 6.51 
would be expected by chance alone less than one time in a hundred. There- 
fore, the F value is said to be significant at the .01 level. We conclude, 
then, that when the covariance analysis was used to equate statistically 
the groups according to vocabulary-test score (this equating was necessary 
since the groups differed at the beginning of training), the methods of 
teaching produced significantly different results on the spelling test. 


SECTION 4.10 


Factorial Analysis of Covariance: 


Two Treatment Variables 


The following example presents the computational steps to be used 
when there are two treatment variables and it is necessary to have sta- 
tistical control of some other variable to draw meaningful conclusions. 


EXAMPLE 


A certain university was engaged in teaching Peace Corps volunteers 
the foreign languages they would need during their tour of duty. The 
following experiment was carried out to determine the effectiveness of the 
different teaching methods that were used. All students were first given a 
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language-aptitude test, which provided the control measures (the X values 
presented in Step 1 below). It is obvious from these X values that the 
students’ language-aptitude scores differed widely. Since all the students 
were not able to participate in the experiment at the same time, they were 
placed in experimental groups on the basis of when they participated 
rather than on the basis of their aptitude scores. The average aptitude 
scores of the resulting experimental groups differed considerably. It is for 
this reason that a covariance analysis was needed. Using statistical pro- 
cedures, the covariance analysis equated the groups on aptitude scores, 
so that any differences found after the experiment could be interpreted as 
results of the experimental manipulations rather than of the ongmal 
differences in aptitudes. 

The experiment that was carried out was to evaluate two methods of 
teaching the foreign languages and to determine the value of language 
laboratory sessions. The two teaching methods were (1) formal classroom 
meetings with lectures and (2) no formal classroom meetings—only conver- 
sation periods held in a congenial atmosphere. In addition, half of the 
students being taught by each teaching method spent three hours a day in 
the language laboratory using the tape-recording equipment. The other 
half of the students in each method group never entered the language lab. 

Two years later, when the volunteers returned from overseas, they 
were asked to evaluate the degree to which their language training prepared 
them for their work. The ratings were on a 10-point scale ranging from 
1 to 10. These ratings served as the criterion measures (the Y scores below). 

Step 1. Table the data as follows. 


Classroom Group 1 —_- Conversation Group 1 
(3 Hrs./Day in Lab) (3 Hrs./Day in Lab) 


Subject xX Y Subject xX MG 
Si 62 5 Su 46 5 
So 75 7 Si 53 4 
S; 41 3 S13 57 3 
S, 88 8 Sis 49 7 
Ss 72 7 Sis 62 6 


Classroom Group 2. Conversation Group 2 
(No Time in Lab) (No Time in Lab) 


Subject xX Ve Subject xX ¥ 
Se 84 2 Sie 58 9 
Sy 91 3 Siz 72 10 
Ss 68 1 Sig 61 8 
So 77 1 Sig 65 8 
Sio 85 3 S20 59 10 
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Step 2. Add the scores in each column, and record the sums. 


Class 1/Lab Converse 1/Lab 
x ¥ xX Ye 
62 5 46 5 
75 iC 53 4 
Sums: 338 30 267 25 


Class 2/No Lab Converse 2/No Lab 


x Y Xx Y 
84 2 58 9 
91 S 1P 10 
Sums: 405 10 315 45 


The Control Variable (Steps 3—15) 
Step 3. Square all the numbers in the X columns (Step 1), and add 
the squares. 
SF ee es wa a Mes Saker eg er Ree ee) adn a MM 1 
“- 58" -F += -F' 59? = 91,587 
Step 4. Add the sums for all four X columns (Step 2). 
338 + 405 + 267 + 315 = 1325 


Step 5. Square the result of Step 4, and divide by the total number 
of X values (20 in this example). 
1323 1,755,625 
0 20 


= 87,781.250 


Step 6. Subtract the result of Step 5 from the result of Step 3. 
91,587 — 87,781.25 = 3805.750 


Step 7. Add the sums of the X columns in the two classroom groups 
(Step 2), square that number, and divide it by the number of cases on 
which the sum is based (10 in our example). 


(338 + 405)? 743? 552,049 
10 0: ee 19 


= 55,204.900 
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Step 8. Add the sums of the X columns in the two conversation 
groups (Step 2), square that number, and divide it by the number of 
cases on which the sum is based (10 in our example). 

(267 + 315)? 582? = 338,724 
10 iste age lO 


Step 9. Add the result of Step 7 to the result of Step 8, and subtract 
the value of Step 5. 


55,204.9 + 33,872.4 — 87,781.250 = 1296.050 


= 33,872.400 


Step 10. Add the sums of the X columns in the two lab groups 
(Step 2), square that number, and divide it by the number of cases on 
which the sum is based (10 in our example). 


(338 + 267)? 605? 366,025 
10 . Oaz6 40 


= 36,602.500 


Step 11. Add the sums of the X columns in the two no-lab groups 
(Step 2), square that number, and divide it by the number of cases on 
which the sum is based (10 in our example). 

(405 + 315)? 720? 518,400 
10 S109 FGao 


Step 12. Add the result of Step 10 to the result of Step 11; then 
subtract the value of Step 5. 


36,602.500 + 51,840 — 87,781.250 = 661.250 


= 51,840 


Step 13. Square each of the sums under the four X columns (Step 2), 
divide each square by the number of cases on which each sum is based 
(5 in our example), and then add the four quotients. 


338? | 405° | 267? 315? ~—- 448,783 


5 ) 5 i) 5 


= 89,756.6 


Step 14. Subtract the results of Steps 5, 9, and 12 from the value of 
Step 13. 


89,756.6 — 87,781.250 — 1296.050 — 661.250 = 18.05 
Step 15. Subtract the result of Step 13 from that of Step 3. 
91,587 — 89,756.6 = 1830.4 


The Criterion Variable (Steps 16-28) 


Step 16. Square all the numbers in the Y columns (Step 1), and add 
the squares. 


Bef ieee fF WMH eee + B24 
tess 6 494 --- 410? = 764 
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Step 17. Add the sums for all the Y columns (Step 2). 
30 + 10 + 25 + 45 = 110 


Step 18. Square the result of Step 17, and divide by the total number 
of Y values (20 in this example). 


1612100 st 
200 0) 


Step 19. Subtract the result of Step 18 from the result of Step 16. 
764 — 605 = 159 


Step 20. Add the sums of the Y columns in the two classroom groups 
(Step 2), square that number, and divide it by the number of cases on 
which the sum is based (10 in our example). 

10)? = 40? 
(30 + 10) = 40? = 1600 Beare 
10 10 10 

Step 21. Add the sums under the Y columns in the two conversation 
groups (Step 2), square that number, and divide it by the number of cases 
on which the sum is based (10 in our example). 

2 2 
(25 + 45) a 70? ka 4900 _ rae 
10 10 10 

Step 22. Add the result of Step 20 to the result of Step 21, and sub- 

tract the result of Step 18. 


160 + 490 — 605 = 45 


Step 23. Add the sums under the Y columns in the two lab groups 
(Step 2), square that number, and divide it by the number of cases on 
which the sum is based (10 in our example). 


(30 + 25)? — 55? 3025 


= 302.5 
10 10 10 


Step 24. Add the sums under the Y columns in the two no-lab 
groups (Step 2), square that number, and divide it by the number of cases 
on which the sum is based (10 in our example). 


2 2 
(10 +45)? 55? 3025 ne 
10 10 “10 


Step 25. Add the result of Step 23 to the result of Step 24, and 
subtract the result of Step 18. 


302.5 + 302.5 — 605 = 0 
Step 26. Square each of the sums under the four Y columns (Step 2), 
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divide each square by the number of cases on which each sum is based 

(5 in our example), and then add the quotients. 
30? 10? | 25? | 45? ~—- 3650 
5 5 5 See: 


= 730 


Step 27. Subtract the results of Steps 18, 22, and 25 from the result 
of Step 26. 
730 — 605 — 45 — 0 = 80 
Step 28. Subtract the value of Step 26 from that of Step 16. 
764 — 730 = 34 


Products of the Two Variables (Steps 29-53) 


Step 29. Multiply each of the X scores in Step 1 by its paired Y 
score, and add the products. 


(62 X 5) +++ + (72 X 7) + (84 X 2) +--+ + (85 X 3) 
+ (46 X 5) +--+ + (62 X 6) + (58 X 9) +--+ + (59 X 10) 
= 7175 


Step 30. Multiply the result of Step 4 by the value of Step 17; then 
divide by the number of XY pairs (20 in our example). 


1325 X 110 =: 145,750 


= 7287.500 
20 20 


Step 31. Subtract the result of Step 30 from the result of Step 29. 
7175 — 7287.5 = —112.5 


Step 32. From Step 2, obtain the X sum and the Y sum for the 
two classroom groups. 


338 + 405 = 743 
30+10= 40 


X sum for classroom groups 
Y sum for classroom groups 


Multiply the X sum by the Y sum, and divide by the number of scores in 
each sum (10 in our example). 


743 X 40 _ 29,720 


10 ie 2972 


Step 33. From Step 2, obtain the X sum and the Y sum for the two 
conversation groups. 


267 + 315 = 582 = X sum for conversation groups 
25 + 45 = 70 = Y sum for conversation groups 
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Multiply the X sum by the Y sum, and divide by the number of scores in 
each sum (10 in our example). 


582 X 70 40,740 
10 Fuso 


= 4074 


Step 34. Add the result of Step 32 to the result of Step 33, and sub- 
tract the value of Step 30. 


2972 + 4074 — 7287.5 = —241.5 


Step 35. From Step 2, obtain the X sum and the Y sum for the two 
lab groups. 


338 + 267 = 605 = X sum for lab groups 
30 + 25 = 55 = Y sum for lab groups 


Multiply the X sum by the Y sum, and divide by the number of scores in 
each sum (10 in our example). 
605 X 55 _ 33,275 
ee mig 


= 3327.5 


Step 36. From Step 2, obtain the X sum and the Y sum for the two 
no-lab groups. 


405 + 315 = 720 = X sum for no-lab groups 
10+ 45 = 55 = Y sum for no-lab groups 


Multiply the X sum by the Y sum, and divide by the number of scores 
in each sum (10 in our example). 
720 X 55 _ 39,600 
10 ~— 10 


= 3960 


Step 37. Add the result of Step 35 to the result of Step 36, and 
subtract the result of Step 30. 


3327.5 + 3960 — 7287.5 = 0 


Step 38. Multiply each X sum in Step 2 by its paired Y sum, divide 
each product by the number of scores on which each sum is based (5 in 
our example), and then add the quotients. 


= 7008 


338 X 30 , 405 X 10 " 267 X 25 315 X 45 _ 35,040 
5 5 5) 5 5) 


Step 39. Subtract the results of Steps 30, 34, and 37 from the result 
of Step 38. 
7008 — 7287.5 — (—241.5) — 0 = —38 


Step 40. Subtract the value of Step 38 from the value of Step 29. 
7175 — 7008 = 167 
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Step 41. Square the result of Step 40, and divide by the value of 
Step 15. 
167? 27,889 


= = 15.237 
1830.4 1830.4 


Then, subtract that quotient from the result of Step 28. 
34 —. 15.237 = 18.763 
Step 42. Add the result of Step 9 to the result of Step 15. 
1296.050 + 1830.4 = 3126.45 
Step 43. Add the value of Step 22 to that of Step 28. 
45 + 34 = 79 
Step 44. Add the result of Step 34 to the result of Step 40. 
(—241.5) + 167 = —74.5 


Step 45. Square the result of Step 44, and divide by the result of 
Step 42. 


(—74.5)? 5550.25 
3126.5 3126.5 


= 1.775 


Then, subtract that quotient and the result of Step 41 from the result of 
Step 43. 
79 — 1.775 — 18.763 = 58.462 


Step 46. Add the final value of Step 12 to that of Step 15. 
661.250 + 1830.4 = 2491.65 
Step 47. Add the result of Step 25 to that of Step 28. 


0+ 34 = 34 
Step 48. Add the result of Step 37 to that of Step 40. 
0 -+ 167 = 167 


Step 49. Square the result of Step 48, and divide by the result of 
Step 46. 


1672 27,889 
2491.65 2491.65 


= 11.193 


Then subtract that quotient and the result of Step 41 from the result of 
Step 47. 


34 — 11.193 — 18.763 = 4.044 
Step 50. Add the value of Step 14 to that of Step 15. 
18.05 + 1830.4 = 1848.450 
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Step 51. Add the value of Step 27 to that of Step 28. 
80 + 34 = 114 
Step 52. Add the value of Step 39 to that of Step 40. 
(—38) + 167 = 129 


Step 53. Square the result of Step 52, and divide by the result of 
Step 50. 


1292 16,641 
1848.45 1848.45 


9.003 


Then, subtract that quotient and the result of Step 41 from the result of 
Step 51. 
114 — 9.003 — 18.763 = 86.234 


Mean Squares and F Ratios (Steps 54-60) 


Step 54. Divide the result of Step 41, which is the adjusted-error 
sum of squares, by the degrees of freedom for adjusted error. The adjusted- 
error df are always N — CL — 1, where N is the total number of XY pairs 
(20 in this example), C is the number of experimental conditions on the 
first variable (2 in this example, for classroom versus conversation), and 
L is the number of experimental conditions on the other variable (2 in this 
example, for lab versus no lab). Thus, V — CL — 1 = 20 — (2X 2) —1= 
20 — 5 = 15. 


18.763 ‘18.763 


= = 1.251 
N—CL—11 15 


This final value is the error mean square, which will make up the de- 
nominator for the three F-tests to follow. 

Step 55. Divide the result of Step 45, which is the adjusted sum of 
squares for teaching methods, by the appropriate degrees of freedom. 
The df are C — 1, where C is the number of experimental conditions in this 
variable (2 in this example, for classroom versus conversation) . 


58.462 58.462 
Car 1 
Step 56. Divide the value of Step 55 by that of Step 54. This will 


yield the F for teaching methods. The df are (C — 1)/(N — CL — 1) = 
1/15. 


= 58.462 


_ 58.462 
en es 


= 46.73 


From Appendix D it is seen that with df = 1/15, an F ratio larger 
than 16.59 would be expected by chance alone less than one time in a 
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thousand. Therefore, the F is said to be significant at the .001 level. This 
means that the different teaching methods were rated as being significantly 
different in their effectiveness. 

Step 57. Divide the result of Step 49, which is the adjusted sum of 
squares for language-lab usage, by the appropriate degrees of freedom. 
The df are L — 1, where L is the number of experimental conditions in this 
variable (2 in this example, for lab versus no lab). 


4.044 4.044 
ko 1 


= 4.044 


Step 58. Divide the value of Step 57 by that of Step 54. This will 
yield the F for language-lab usage. The df are (L — 1)/(N — CL — 1) = 
(2 — 1)/(20 — 5) = 1/15. 


F = —— = 3.23 


Appendix D shows that the probability of getting a value larger than 
this F is between five and ten in one thousand. Therefore, we conclude that 
there is no difference in language effectiveness depending upon whether one 
spends three hours in the lab or no time in the lab. 

Step 59. Divide the result of Step 53, which is the adjusted sum of 
squares for the methods-by-lab interaction, by the appropriate degrees of 
freedom. The df are (C — 1) (Z — 1), or the product of the df from Step 55 
and the df from Step 57. 


86.234 _ 86.234 
(Osan ti (DER ep ct 


= 86.234 


Step 60. Divide the value of Step 59 by that of Step 54. This will 
yield the F for the methods-by-lab interaction. 


The df for this F are 
CC ea eae od 


N—CL—-1 15 


Appendix D shows that this F is significant at the .001 level. Since 
we have found that the teaching methods affect (interact with) the lab 
experience, we would wish to seek out the source of the interaction. The 
statistical procedures to use for such an undertaking are presented in 
Section 3.6. If you find a significant interaction in your data, go to Section 
3.6 and proceed. 
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SECTION 4.11 


Reliability of Measurement: The Test As a Whole 
(Test-Retest, Parallel Forms, and Split Halves) 


The three coefficients of reliability presented here all start with the 
computation of a Pearson product-moment correlation coefficient. 

1. The test-retest reliability measure is computed when you have 
pairs of scores obtained from two different administrations of the 
same test to the same people. If you have such pairs of scores, 
label the scores obtained on the first administration as X and 
those obtained on the second administration as Y. Then, go to 
Section 4.1 and follow the instructions. The computed value will 
be the test-retest reliability coefficient (sometimes called the 
coefficient of stability). 

2. The parallel-forms reliability measure is computed when you have 
pairs of test scores from two tests composed of “equated” items. 
If you have such pairs of scores, label them X and Y, go to Section 
4.1, and follow the instructions. The computed value will be the 
parallel-forms reliability coefficient (sometimes called the measure 
of equivalence and stability) . 

3. The split-halves reliability measure is computed when you have 
given a test to several individuals and then formed pairs of scores 
by dividing the test items into two equal groups. (The usual 
method is to put even-numbered items in one group and odd- 
numbered items in the other group). The pairs of scores are then 
used to compute the correlation. Carry out the following steps in 
order to compute the split-halves reliability coefficient. 

Step 1. Go to Section 4.1 and follow the instructions. When you 
have the correlation coefficient, return to this section and go on to the 
next step. 

Step 2. In order to compute the correlation, you divided the test 
in half. This means that the real or whole test is twice as long as either 
half used to compute the reliability coefficient. When a test is lengthened, 
the reliability increases. You must therefore ‘“correct”’ the value obtained 
in Step 1 so that it effectively pertains to the whole test rather than to 
just half of it. 

In order to correct the value of Step 1, first multiply the answer of 
Step 1 by the number 2. For example, suppose the correlation value from 
Step 1 is .83. 

83 X 2 = 1.66 


Step 3. Now add the number 1 to the result of Step 1. 
1+ .83 = 1.83 
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Step 4. Divide the result of Step 2 by the result of Step 3. 


1.66 | 


—— = .91 
1.83 


This value is the split-halves reliability coefficient corrected so that it 
applies to the whole test. A high reliability value (.70 or higher) shows 
that the test is reliably (accurately) measuring the characteristic it was 
designed to measure. 


SECTION 4.12 


Reliability of Measurement: The Individual Items 
(Kuder-Richardson and Hoyt) 


When your main concern is whether the items in a test are fairly 
homogeneous in terms of how the individuals responded to the items, 
the measure of reliability to be used is the Kuder-Richardson coefficient. 
The computational method presented here was actually developed by 
Hoyt. It uses the analysis of variance and is somewhat simpler than the 
original formulation. Hoyt’s basic formula for reliability is 


Vy = V5 
Ve 


eo 


where V, = variance for remainder sum of squares 
V. = variance for examinees 


EXAMPLE 


Suppose that an experimenter wishes to test the reliability of a certain 
ten-item test. He administers the test to eight subjects and grades their 
answers. Then, for the purposes of determining reliability, he records for 
each subject on each test item whether the question was answered correctly 
(indicated by the number 1) or incorrectly (indicated by the cipher, 0). 
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Step 1. Table the data as follows. 


Subject Test Items 

1 2 3 4 5 6 7 8 oe 10 
Si 1 1 1 1 1 1 1 1 1 1 
S2 0 0 0 1 1 0 1 1 1 1 
S3 0 0 1 1 1 0 0 0 0 0 
Ss 0 0 1 1 1 1 1 0 1 1 
Ss 0 1 1 1 1 0 1 0 1 1 
Se 1 1 0 1 0 0 1 1 1 0 
S7 0 0 1 1 0 0 1 0 0 1 
Ss 1 1 0 1 1 1 1 0 1 1 


Step 2. Count the number of items that each subject answered cor- 
rectly (in this example, 10 for the first subject, 6 for the second subject, 
etc.). List the totals for each subject. 


No. of Correct 


Subject Answers 
Sy 10 
So 6 
S3 3 
Ss i 
Ss 7 
Se 6 
S7 4 
Ss 8 


Step 3. Add the number of correct answers (Step 2), and record 


the sum. 
100+6+---+8=51 


Step 4. Square each number of correct answers in Step 2; then add 
the squares and divide that sum by the number of items in the test (10 in 
this example). 

10 0" ss Se Rod 


= = 35.9 
10 10 


Step 5. Square the result of Step 3, and divide by the product of the 
number of people by the number of items (8 X 10 = 80 in this example). 


512 2601 


Step 6. Subtract the result of Step 5 from the result of Step 3. 
51 — 32.512 = 18.488 
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Step 7. Subtract the result of Step 5 from the result of Step 4. 
35.9 — 32.512 = 3.388 
Step 8. Count the number of subjects who correctly answered each 


item. List the totals for each item. 


No. of Persons 


Item Correct 
1 3 
2 4 
3 5 
4 8 
5 6 
6 3 
7 7 
8 3 
9 6 

10 6 


Step 9. Square each number of persons correct in Step 8; then add 
the squares and divide that sum by the number of people who took the test 
(8 in this example). 


B+ 424 ---46? 289 
8 


Step 10. Subtract the result of Step 5 from the result of Step 9. 
36.125 — 32.512 = 3.613 


Step 11. Subtract the result of Step 7 and the result of Step 10 from 
the result of Step 6. 


18.488 — 3.388 — 3.613 = 11.487 


Step 12. Divide the result of Step 7 by N — 1, where N is the number 
of subjects who took the test (8 in this example). 


3.388 _ 3.388 4a, 
NN [peg ) oper 


Step 13. Divide the result of Step 11 by (VN — 1)(UJ — 1), where 
N is the number of subjects who took the test (8 in our example) and J is 
the number of items in the test (10 in our example). 


11.487 _ 11.487 _ 11.487 
(N — tha). 25on, aie 


Step 14. Subtract the result of Step 13 from the result of Step 12. 
484 — .182 = .302 


= .182 
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Step 15. Divide the result of Step 14 by the result of Step 12. This 
yields the value of the Kuder-Richardson (or Hoyt) reliability coefficient. 


A high reliability coefficient (.70 or higher) would mean that the test 
was accurately measuring some characteristic of the people taking it. 
Further, it would mean that the individual items on the test were producing 
similar patterns of responding in different people. Therefore, a high value 
would mean that the test items were homogeneous and, therefore, valid. 


SECTION 4.13 
Test for Difference Between Independent Correlations 


If you have two correlations computed from data that were gathered 
from two different groups of individuals, the correlation coefficients will be 
experimentally independent. In such a case, you may use the following 
procedure to test for significance of the difference between the correlations. 


EXAMPLE 


Suppose we have a correlation coefficient of +.68 that was computed 
between grades in an English class and IQ scores for thirty-eight people. 
Suppose further, that we have a correlation coefficient of +.36 between 
grades in a similar English class and IQ scores for a different group of 
seventy-three people. We wish to know whether these coefficients are 
different. 


Step 1. First, change the two correlations into Fisher z scores. This 
can be done by means of any table of such transformations (see Appendix E) : 


Correlation of .68 z of .829 
Correlation of .36 = z of .377 


I 


Step 2. Subtract either z score of Step 1 from the other. 
829 — ,3877 = .452 


192 / Part 4 Correlation and Related Topics 


Step 3. Subtract 3 from the number of people in the group for which 
the first correlation was computed (38 in this example). (Note: The 
number 3 is always used.) 

38 — 3 = 35 
Step 4. Divide the result of Step 3 into the number 1 (i.e., take the 


reciprocal of 35). Carry the answer to four decimal places. 


1 
— = .0286 
35 


Step 5. Subtract 3 from the number of people in the group for which 
the second correlation was computed (73 in this example). 


73 — 3 = 70 


Step 6. Divide the result of Step 5 into the number 1 (1.e., take the 
reciprocal of 70). Carry the answer to four decimal places. 


Step 7. Add the result of Step 4 to the result of Step 6. 
.0286 + .0143 = .0429 
Then take the square root of the sum. 
/.0429 = .207 


Step 8. Divide the result of Step 2 by the result of Step 7. This yields 
a z statistic. 


A z larger than 1.96 is significant at the .05 level using a two-tailed test 
(see Appendix A). A significant z tells us that the two correlation values 
are very likely really different. 
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SECTION 4.14 


Test for Difference Between Dependent Correlations 


The following procedure is used to determine the significance of the 
difference between experimentally dependent correlations—i.e., correlations 
based on data taken from the same group of people. 


EXAMPLE 


Suppose it is known that the correlation between grades in a statistics 
course and overall grade point average (GPA) for sixty-three students is 
+.70. Suppose it is also known that the correlation between grades in an 
introductory psychology course and overall GPA for those same sixty- 
three students is +.40. If you wish to test for the significance of the differ- 
ence between these two correlations, you must first be aware of the fact 
that they are related or dependent. Then, you must find the remaining 
correlation between statistics grades and introductory-psychology grades 
for the sixty-three students. Suppose that correlation is +.30. 

Step 1. You have the following three correlations: 


Statistics grade with GPA = +.70 
Introductory psychology grade with GPA = +.40 
Statistics grade with psychology grade = +.30 


I 


Compute the difference between the two correlations of interest (in this 
example, the first two). 
.70 — .40 = .30 


Step 2. Subtract 3 from the number of individuals involved in the 
correlations (63 in this example). (Note: The number 3 is always used.) 


63 — 3 = 60 


Step 3. Add 1 to the third correlation in Step 1—i.e., the correlation 
that you are not presently interested in (+.30 in this example). (Note: The 
number 1 is always used.) 

.30 + 1 = 1.30 
Step 4. Multiply the result of Step 2 by the result of Step 3. 
60 X 1.30 = 78 
Then, take the square root of the product. 


4/78 = 8.832 
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Step 5. Multiply the result of Step 1 by the result of Step 4. 
30 X 8.832 = 2.65 


Step 6. Square each of the three correlation values from Step 1, and 
add the squares. 


.70? + .40? + .30? = .49 + .16 + .09 = .74 
Step 7. Multiply the three correlation values from Step 1. 
.70 X .40 X .80 = .084 


Step 8. Multiply the result of Step 7 by 2, and then add 1 to the 
product. (Note: The numbers 2 and 1 are always used.) 


(2 X 084) +1 = .168 + 1 = 1.168 
Step 9. Subtract the result of Step 6 from the result of Step 8. 
1.168 — .74 = .428 
Step 10. Multiply the result of Step 9 by 2. 
2 X 428 = .856 
Then, take the square root of the product. 


V 856 = .925 


Step 11. Divide the result of Step 5 by the result of Step 10. This 
yields a ¢ statistic. 


Maloy eats 


The appropriate degrees of freedom are given as the result of Step 2, i.e., 
60. A ¢ larger than 2.00, with 60 df, is significant at the .05 level using a 
two-tailed test (see Appendix B). A significant ¢ tells us that the two 
correlation values are very likely really different. 


PART 5 


Nonparametric Tests, Miscellaneous Tests of 


Significance, and Indices of Relationship 


In many cases where it is desired to make comparisons of two pro- 
portions, or of two medians, or within a table of frequency counts, there 
are some very simple tests that can be used. Some of these simple tests 
are listed in the following six sections. Various names—such as nonpara- 
metric tests or distribution-free tests—have been applied to many such tests 
of significance. We will not attempt to argue the merits and deficiencies of 
these tests, but will merely point out that they are relatively easy to use 
and that they are often applicable when the various tests presented else- 
where (e.g., in sections 1.4 through 2.11) are not. 

The six sections in this part are discussed below in three sets of two 
each. These discussions should help you choose the correct analysis for 
your particular problem. 

1. Significance tests for proportions 

2. Significance tests for differences between two groups 

3. Tests for (1) significance of differences or (2) relationships, when 

data are gathered into contingency tables 


Tests for Proportions (Sections 5.1 and 5.2) 


If you have a proportion that has been computed from experimental 
data (such as the proportion of all American men over forty who have 
been married at least two times) and you wish to find whether it differs 
from some specific value (such as a guess that one third, or .33, of all 
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American men over forty have been married at least two times), the 
material presented in Section 5.1 will help you solve the problem. If you 
wish to find whether two independently computed proportions are different, 
use the analysis presented in Section 5.2. 


Tests for Differences Between Two Groups (Sections 5.3 and 5.4) 


Section 1.5 (t-test for independent means) shows how to find whether 
two mean values are different. If you wish to find whether two independent 
median values are different, use the procedure in Section 5.3. 

Section 1.6 (t-test for related measures) presents the method for 
finding whether two means are different when the samples are paired, 
matched, or otherwise related. If you wish to test whether two related 
groups differ on the basis of a simple sign test, use the analysis in Section 5.4. 


Tests for Data in Contingency Tables (Sections 5.5 and 5.6) 


When you have frequency data (counts of the people exhibiting the 
characteristic of interest to you) that can be put into the form of a con- 
tingency table, you probably wish to ask one side or the other of a two-sided 
question: (1) Do these variables (treatments) produce different results? 
or (2) Are these variables related, and if so, how highly related? Both 
questions can be answered by the tests presented in Sections 5.5 and 5.6. 
The first question is a chi-square question, and the first part of either 
Section 5.5 (if you have a 2 X 2 table of data) or Section 5.6 (if you 
have a larger number of cells in the table) will help you answer it. The 
second question is a phi-coefficient question or a contingency-coefficient 
question depending on the number of cells in your table, and the last part 
of either Section 5.5 or 5.6 will help you answer it. 


In the following sections, computational formulas are again presented 
where they contribute to the understanding of the analysis. In those 
instances where the computation involves only a count or ranking, the 
formula is omitted. 
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SECTION 5.1 
Test for Significance of a Proportion 


In a situation where a logically dichotomous variable, such as passing 
or failing a course, is considered, the use of proportions can sometimes 
facilitate the statistical analysis of significance. Before the test of signifi- 
cance can be executed, it is necessary to know the proportion to be expected. 
If one is tossing a coin, for example, he expects to get heads one half of 
the times (in the long run) ; thus, the expected proportion is .50. If one is 
tossing a die, he expects to get a one-spot one time in six; thus, the expected 
proportion is 1/6. When the dichotomy is on a variable such as passing or 
failing a course, you must either (1) know the expected proportion from 
some previous experience, (2) insist on some a priori proportion, such as 
“10 per cent will fail,” or (3) in some other way determine or state the 
expected proportion. Then, when the actual proportion has been determined 
and the expected proportion has been decided upon, the test for signifi- 
cance can be carried out. 


EXAMPLE 


Assume that a teacher wishes to determine whether a particular class 
of fifteen students is under par in its performance on an arithmetic achieve- 
ment test. She decides to do this simply by determining if the proportions 
who passed and failed correspond to those proportions in classes she has 
taught in previous years. 

Step 1. In order to determine the actual or observed proportion, 
the first step is to record and table the data on which the proportion will 
be based (in this case, the arithmetic scores) . 


Student Score 


OAZZe RU TMoOst VOWS 
2 
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Step 2. In order to compute the proportion of students who passed, 
the teacher must set a pass-fail cutoff point. Suppose she decides that a 
score of 50 or more is passing and a score of 49 or less is failing. We can 
quickly see that Students B, F, H, K, L, and O failed. Six out of fifteen 
failed; thus, nine out of fifteen passed. The proportion (p) of students 
who passed is the number who passed divided by the total number of 
students. 


Step 3. Suppose the teacher’s information from previous classes indi- 
cates that, on the average, 80 per cent (or .80) of the students got a passing 
grade on this examination. The .80 expected to pass is the P value. The 
significance test (z-test) for the obtained proportion is computed by use 
of the following formula. 


sem Dearden, 
. fea 
N 
Thus, for this case, 
.60 — .80 —.20 —.20 — 20 — 20 
oe 80(.20) 16/0107 —-1034 
15 15 15 


= hes 


In order to have a significant difference, at the .05 level using a two-tailed 
test, the z would need to be at least +1.96 (see Appendix A). A significant 
z would mean that the p value is significantly different from the P value. 
In this case, it is concluded that the scores of the fifteen students are not 
under par for the arithmetic achievement test. 
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SECTION 5.2 


Test for Significance of Difference Between Two 


Proportions 


When dealing with data on a logically dichotomous variable, it is easy 
to test the significance of a difference between the proportions. 


EXAMPLE 


In an experiment on short-term memory for a single item, the following 
conditions were used. The item was presented to all subjects for 2 seconds. 
One group of twenty subjects was tested to determine if they recalled the 
item after 5 seconds; the other group of twenty subjects was tested after 
10 seconds. If the item was correctly recalled, a “‘“+’’ was recorded for 
that subject; if an incorrect response was made, a ‘‘0”’ was recorded. 

The formula for the significance of the difference between two pro- 
portions is 

J iz ak's 


a = 
phlei pitigep(he—sip) 
NeaNoeet aN: 


where the value of p under the radical is computed as: 


_ NiPit NoPs 
Na se NG 


Step 1. In order to compute the two proportions P; and P»:, from 
Groups 1 and 2 respectively, first table the data as follows. 


Group 1 Group 2 

Recall Recall 

Subject (5 sec) Subject (10 sec) 
Si =f Sa 0 
S2 ap Soo 0 
S3 ap So a5 
Ss ae So 0 
Ss tr Sos st 
Se AF S26 =e 
Sy ar Sor 0 
Ss =f Sos a 
So = Sag 0 
Sto 0 S30 0 
Su sp Sa nF 
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Recall Recall 

Subject (5 sec) Subject (10 sec) 
Sto 0 S3o 0 
Si3 0 S33 0 
Su a\ S34 0 
Sis 55 S35 0) 
Sis 0 S36 SF 
Sir + S37 0 
Sis ae S38 0 
Sig si S39 + 
S20 aE Sao ae 


Step 2. Subjects 10, 12, 13, and 16 in Group 1 missed the item; 
thus, a total of 16 subjects recalled correctly. The number correctly re- 
calling, divided by the number of subjects in the group, gives the proportion 
who correctly recalled the item. 


Step 3. Subjects 21, 22, 24, 27, 29, 30, 32, 33, 34, 35, 37, and 38 in 
Group 2 missed the item. Thus, 12 subjects missed, and only 8 correctly 
recalled the item. Again, the number who correctly recalled, divided by 
the number of subjects in the group, gives the proportion who correctly 
recalled the item. 


Step 4. Multiply the result of Step 2 by the value of N, (the number 
of cases in the first sample). 


80 X 20 = 16 


Then multiply the result of Step 3 by the value of N. (the number of cases 
in the second sample). 


.40 X 20 = 8 
Step 5. Add the two numbers computed in Step 4. 
16+ 8 = 24 


Then divide that answer by the total number of cases in both samples 
(Ni + No = 40). 


24/40 = .60 This is the value of p. 
Step 6. Subtract the final result of Step 5 from the number 1. 
1 — .60 = .40 
Then multiply that number by the final result of Step 5. 
-60 X .40 = .24 
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Step 7. Divide the result of Step 6 by N, (the size of the first sample). 
24/20 = .012 

Step 8. Divide the result of Step 6 by N2 (the size of the second sample). 
24/20 = .012 

Step 9. Add the result of Step 7 to the result of Step 8. 


.012 + .012 = .024 
Then take the square root of that sum. 


\/ 024 = .155 

Step 10. Subtract the result of Step 3 from the result of Step 2. 
.80 — .40 = .40 

Step 11. Divide the result of Step 10 by the result of Step 9. 
40/.155 = 2.48 


A z having value greater than or equal to 1.96 or less than or equal to 
— 1.96 is considered significant at the .05 level using a two-tailed test (see 
Appendix A). Now, a significant z tells us that the two proportions are 
significantly different. Thus, in the above problem, the two proportions 
significantly differ. 


SECTION 5.3 


The Mann-Whitney U-Test for Differences Between 


Independent Samples 


Occasionally the data collected by an experimenter are badly skewed. 
For this reason, he might choose to use the Mann-Whitney U-test rather 
than the t-test for independent groups. 

The basic formula for the Mann-Whitney U-test is 


1 
y = ning + ED) 575 
or 
1 
(gl => ohms ) — R. 
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where n, = size of the smaller sample 
nm. = size of the larger sample 
R, = sum of the ranks of the smaller sample 
R, = sum of the ranks of the larger sample 


When either U or U’ has been computed, the other can be quickly found by 
U = mn, — U' 

or 
U’ = mn. — U 


Therefore, it is necessary to compute only one; the other is then obtained 
by subtraction. 


EXAMPLE 


Suppose that the following data have been collected representing 
weekly incomes for stenographers who are members of two different 
ethnic groups. The experimenter wishes to determine whether there is a 
significant difference between these incomes. 


Group 1 Group 2 
Weekly Income Weekly Income 
Subject (dollars) Subject (dollars) 

Si 87 Sio aah 
S2 72 Su 94 
S3 65 Si 77 
Sa 54 Sis 88 
Ss 67 Sus 116 
So 76 Sis 90 
S7 73 Sis 87 
Ss 82 Su 76 
So 104 Sig 95 

Sig 164 

S29 127 

Sx 77 


Step I. Rank all the numbers in both groups taken together according 
to the size of the number, beginning with the smallest. (Note: When there 
are equal measures, the same rank is assigned to each. But notice that the 
rank assigned is the mean value of the tied ranks. For example, there are 
two incomes of 76 dollars, which are tied for the sixth and seventh ranking 
positions. Therefore, they are both assigned the rank of 6.5.) 
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Group 1 Group 2 
Income Rank Income Rank 
87 TRS 131 20 
72 4 94 15 
65 2 Cie 8.5 
54 1 88 13 
7 3 116 18 
76 6.5 90 14 
73 5 87 (ets) 
82 10 76 6.5 
104 17 95 16 
164 2] 
127 19 
77 8.5 


Step 2. Count the number of measures in each group, and then 
multiply these numbers. (Here, there are 9 measures in Group 1 and 12 
in Group 2.) 

9 X 12 = 108 


Step 3. Add 1 to the number of measures in Group 1; then multiply 
that sum by the original number (9 in this example), and divide the 
product by 2. 

9+1)9 (10)9 90 
eS So eee”: 


= 45 


Step 4. Add the ranks for Group 1. 
115+4+-++-+17 = 60 


Step 5. Add the result of Step 2 to the result of Step 3, and subtract 
the sum of Step 4. This yields the value of U. 


U = 108 + 45 — 60 = 93 


Step 6. Subtract the result of Step 5 from the result of Step 2. This 
yields the value of U’. 


U’ = 108 — 93 = 15 


If the number of measures in the larger group is greater than 8, and the 
number of measures in either group is less than 21, take whichever answer, 
from Steps 5 and 6, is smaller, and look in tables of U values to check for 
significance (see Appendix G). In the present example, n1 = 9 and nz = 12 
so both requirements are satisfied. Thus, go to Appendix G, look in the table 
for the appropriate alpha level, and see whether the value is smaller than 
would be expected by chance. For this example, using a two-tailed test, 
if alpha is .05, we see that if the value is 26 or less, the difference is significant. 
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If the number of measures in either group is greater than 20 carry 
out the following steps. 


Step 7. Divide the result of Step 2 by 2. 


108 _ 
ee 


54 


Then, subtract that quotient from the result of Step 5. 
93 — 54 = 39 


Step 8. Add together the number of measures in each group; then 
add the number 1. 


9+ 12+ 1 = 22 
Step 9. Multiply the result of Step 2 by the sum of Step 8. 
108° X' 22*= "2376 


Step 10. Divide the result of Step 9 by the number 12. (Note: The 
number 12 is always used.) 

2376 

Py 


198 


Then, take the square root of that quotient. 
+/198 = 14.071 
Step 11. Divide the result of Step 7 by the result of Step 10. 


This is a 2, or critical-ratio, test. A value greater than +1.96 is significant 
at the .05 level using a two-tailed test (see Appendix A). The hypothesis 
tested by the Mann-Whitney analysis is that the medians of the two groups 
are equal. A z value that is large enough so that the hypothesis is rejected 
tells us that the chance of the medians being the same is very small. It is 
concluded, then, that there is a significant difference between the median 
incomes of stenographers in the two ethnic groups. 
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SECTION 5.4 


A Sign Test (Wilcoxon) for Differences Between 
Related Samples 


The Mann-Whitney U-test presented in Section 5.3 is a nonpara- 
metric test for independent samples. The Wilcoxon signed-ranks test is 
applicable where the samples are related (i.e., not independent). 


EXAMPLE 


Suppose we have collected the reading-rate scores for a group of ten 
people before and after they enrolled in a course in speed reading. We wish 
to determine if the course made any significant difference in reading rate. 

Step 1. Table the data as follows. Since these are related measures, 
they must be tabled in appropriate pairs. 


Subject Rate Before Rate After 


A 150 145 
B 135 138 
Cc 102 121 
D 96 115 
E 127 134 
F 118 132 
G 132 138 
H 124 145 
i 115 126 
J 103 94 


Step 2. Subtract each number in the first column from its paired 
number in the second column, and record the differences. 


Subject After Before Difference 
A 145 150 —5 
B 138 135 3 
C 121 102 19 
D 115 96 19 
E 134 127 7 
F 132 118 14 
G 138 132 6 
H 145 124 21 
I 126 115 11 
J 94 103 —9 
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Step 3. Rank the difference values (Step 2) according to the size 
of the number, beginning with the smallest. Ignore the sign (i.c., use 
absolute values). 


Difference Rank 


ou on 


bo i 
— cs 
mt 


Step 4. Add the ranks for all the difference values that are negative 
(see Step 3). (In this example, the two negative differences, —5 and —9, 
are ranked 2 and 5, respectively.) 


2+5=7 


Note: Zero differences are not used in the computation. The N which is 
used in consulting the table (Appendix J) must be reduced by the number 
of zero difference cases. 


Step 5. Add the ranks for all the difference values that are positive 
(see Step 3). 


1+85+85+4+7+3+10+6 = 48 


Step 6. The results of Steps 4 and 5 are the signed-rank values. 
Take the result that is smaller (7 in this example) and look in a table of 
Wilcoxon’s signed-rank probabilities (see Appendix J) to check for sig- 
nificance. When the number of pairs is 10, as it is in this example, a value 
of 8 or less is significant at the .05 level using a two-tailed test. Since the 
result of Step 4 (1.e., 7) is smaller than 8, we have a significant difference. 
We conclude that the reading rate after training was significantly faster 
than before training. 
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SECTION 5.5 
Simple Chi-Square and the Phi Coefficient 


When you have frequency data comparing the effects of two variables 
and there are two groups on both variables, the phi coefficient can be 
quickly computed to show the degree of the relationship between the two 
variables. Then, the simple chi-square can be easily computed from the 
phi coefficient. The chi-square test will establish whether the variables are 
related. A significant chi-square is interpreted as showing a relationship 
between the two variables. The phi coefficient gives a numerical value, 
ranging from 0 to +1, for that relationship. 


EXAMPLE 


Consider data collected on the two variables (1) gum-chewing activity 
and (2) educational background. The experimenter simply sampled two 
groups with differing educational backgrounds. Within each group, the 
subjects were classified according to their gum-chewing behavior. 

The basic computational formula for phi (¢) is 


i AD — BC 
V(A+B)(C+ D)(A+ C)(B+D) 


where the numbers represented by the letters A, B, C, and D come from 
the contingency table 


phi 


And the formula for chi-square is 
x = N¢? 
where N = the total of all the values in the contingency table. Or, as it is 
usually stated, 
_ N(AD — BC)? 
** (A-+ B)(C + D)(A + C)(B + D) 


Step 1. Organize the data into a contingency table, as follows. The 
values in the table represent the number of persons in each category. 
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Gum Behavior 
Chews Eschews 
High-School Dropout 90 50 


Educational History 


College Graduate 20 30 


Step 2. Add all the numbers in the table. 
90 + 50 + 20 + 30 = 190 
Step 3. Add the numbers in each row to get the row sums. 


90 + 50 = 140 = sum for Row 1 
20 + 30 = 50 = sum for Row 2 


Then, add the numbers in each column to get the column sums. 


Column 1 Column 2 


90 50 
+ 20 + 30 
Sums: 110 80 


Step 4. Multiply together the four sums from Step 3. 
140 X 50 X 110 X 80 = 61,600,000 
Step 5. Take the square root of the result of Step 4. 


V 61,600,000 = 7848.567 


Step 6. Multiply the number from the upper-left square by the 
number from the lower-right square (Step 1). 


90 X 30 = 2700 


Step 7. Multiply the number from the upper-right square by the 
number from the lower-left square (Step 1). 


50 X 20 = 1000 


Step 8. Get the results of Step 6 and 7, and subtract the smaller from 
the larger. 
2700 — 1000 = 1700 


Step 9. Computation of phi: Divide the result of Step 8 by the 
result of Step 5. 
1700 


ie eng 
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This value of phi is an indicator of the degree of relationship between the 
two variables in this example; it is similar in meaning to a correlation 
coefficient. 

Step 10. Square the result of Step 9, and multiply it by the result of 
Step 2. This yields the value of chi-square. 


x? = .217 X 190 = .047 X 190 = 8.93 


The number of degrees of freedom for this simple chi-square will always 
be 1. A chi-square value larger than 3.8, with one df, is significant at the 
.05 level (see Appendix C). It is concluded, therefore, that educational 
background and gum-chewing behavior are significantly related. 

The preceding chi-square test is strictly valid only when the frequency 
counts in all the cells of Step 1 are at least 5. 


SECTION 5.6 


Complex Chi-Square and the Contingency 
Coefficient (C) 


When you have frequency data comparing the effects of two variables 
and there are more than two groups on either of the two variables, the 
complex chi-square can be used to test the hypothesis of no relationship 
between the variables. If the chi-square test shows that there is most 
likely a relationship between the variables, then the contingency coefficient 
can be computed to give an indication of the degree of the relationship. 


EXAMPLE 


Suppose we gather income information for three groups of people: 
(1) those under 26 years of age, (2) those between 26 and 60 years of age, 
(3) those 61 years of age and older. The incomes are categorized according 
to three-thousand-dollar ranges, and a frequency count is made for each 
category. 

The basic formula for chi-square to be used here is 


O — E)? 
¢= DC 
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where O = the observed frequency for a particular cell of the contingency 
table (see Step 1) 
E = the expected frequency for a cell, based upon marginal totals 
(see Steps 2 through 6 for a complete definition) 
The relationship between the contingency coefficient (C) and chi-square is 


x 
C= 
pe oe 
where x? = the chi-square value 
N = the total of all the values in the contingency table 


Step 1. Organize the data into a contingency table, as follows. As 
indicated above, the values in the table represent the number of persons 
falling into each category. 


Income Groups 
(dollars) 


Under 3,000— 6,000—- Over 
3,000 6,000 9,000 9,000 


Under 26 


Age Group 26 through 60 


Over 60 


Step 2. Add all the numbers in the table to obtain a grand total. 
ASF 80 ~ siee 20 0 ee 0 0 ess 10 = 300 
Step 3. Add the numbers in each row to obtain the row sums. 


40 + 30 + 10 + 20 = 100 = sum for Row 1 
50 + 60 + 20 + 70 = 200 = sum for Row 2 
10 + 20 + 20+ 10 = 60 = sum for Row 3 


Step 4. Add the numbers in each column to obtain the column sums. 


Column 1 Column 2 Column3 Column 4 


40 30 10 20 

50 60 20 70 

+ 10 + 20 + 20 + 10 

Sums: 100 110 50 100 


Step 5. Make a new table similar to the one in Step 1, but get the 
new numbers as follows. 
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Compute the new number for each square in the table by using the 
row sum from Step 3 and the column sum from Step 4 of the row and 
column that intersect at the square in which you are interested. For ex- 
ample, to compute the new number that goes into the upper-left square, 
get the sum for Row 1 from Step 3 and the sum for Column 1 from Step 4; 
multiply these numbers together, and divide by the result of Step 2. 


100 x 100 10,000 


= 27.778 
360 360 


Continue this operation for each square in the new table. 


11 
Row 1 X Column 2: Les ED = 30.556 
360 
100 0 
Row 1 X Column 3: ee = 13.889 
360 
100 x 100 
Hee Se Cold ee ovine 
360 
200 100 
Row 2 X Column 1: ae = 55.556 
360 
200 X 110 
Row 2 X Column pies ATs = 61.111 
360 
20 50 
Row 2 X Column 3: ise alas S = Pith 
360 
0 X 100 
Row 2 X Column 4: mb aaa s = 55.550 
360 
0 <X 100 
Row 3 X Column 1: seta alata = 16.667 
360 
60 X 110 
BW 3 5¢ Colnmn Ose = 18-333 
360 
60 < 50 
Row 3 X Column 3: 360 = {.sk') 
60 < 100 
Row 3 X Column 4: ee = 16.667 


Step 6. Put the numbers from Step 5 into the same tabular form as 
that of Step 1. 
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Age Group 


Income Groups 


(dollars) 
Under 3, 000- 6, 000- Over 
3,000 6,000 9,000 9,000 


Under 26 


27.778 


26 through 60 55.556 


Over 60 16.667 


Step 7. The chi-square values can now be computed using the two 
tables of Step 1 and Step 6. To get these values, take the numbers from 
the same squares of the two tables, subtract the smaller from the larger, 
and square that value; then divide by the number that came from the 
table of Step 6. 

For example, the number in the upper-left square of the table of Step 1 
is 40, the number from the same square in the table of Step 6 is 27.778. 
To get the first number for the chi-square, subtract 27.778 from 40, square 


that difference, and then divide the square by 27.778. 


aS ~~ 20778 ~ SRT * 
Continue for each of the other values. 
Row L: 
(30.556 — 30)? 556.809 
30.556 30.556 30.556 
(13.889 — 10)? 3.889? ~—- 15.124 
13.889 13.889 13.889 
(27.778 — 20)? 7.778" ~ 60497 
27.778 27.778 27.778 
Row 2: 


(40 — 27.778)? — 12.222? = 149.377 


(55.556 — 50)? = 5.556? 30.869 
5 


55.556 5.556 55.556 

(61.111 — 60)? 1.11P 1.234 
61.111 yablin "Gri * 

(27.778 — 20% 7.778% 60.497 _ 
27.778 ‘Vear.tis ects © 


(70 — 55.556)? 
55.556 


14.444? 208.629 
55.556 


55.556 


5.378 


1.089 


2.178 


2.178 


3.755 
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Row 3: 
(16.667 — 10)? 6.6672. 44.449 
= a = = 2.667 
16.667 16.667 16.667 
(20 — 18.333)? 1.667? 2.779 fe 
18.332 S R358 teosa 
(20 — 8.333)? 11.667?__-136.119 | ere 
8.333 ee te 
(16.667 — 10)2 6.6672 44.449 
= “= = 2.667 


16.667 ~ 16.667 16.667 


Step 8. Chi-square is computed by adding all the values that were 
computed in Step 7. 


x? = 5.378 + .01 + +++ + 2.667 = 36.985 


Step 9. The degrees of freedom for this chi-square will always be the 
number of rows minus 1, multiplied by the number of columns minus 1. 
(In the present example, there are 3 rows and 4 columns.) 


df= (8—1)(4-—1) =2X3=6 


A chi-square value larger than 12.6, with 6 degrees of freedom, is significant 
at the .05 level (see Appendix C). 

Step 10. The extent of the relationship between the two variables 
can be found by first adding the result of Step 8 to the result of Step 2. 


36.985 + 360 = 396.985 
Step 11. Divide the result of Step 8 by the answer of Step 10. 


36.985 
= .093 
396.985 


Then, take the square root of that quotient. This yields the contingency 
coefficient. 
C = V.093 = .305 


This contingency coefficient, which is similar in meaning to the correlation 
coefficient, has already been shown to be significantly different from zero 
by the test concluded in Step 9. Thus, it is concluded that age and income 
are significantly related. 
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APPENDIX A 
Normal-Curve Areas 


To read this table, first find the z value in which you are interested 
by looking down the first column for the units and tenths values, and 
across the first row for the hundredths value. The sign of z, whether positive 
or negative, is not important for reading the table since it merely indicates 
whether the z lies to the left or right of the mean. After locating the z value 
of interest, the number in the body of the table represents the proportional 
part of the area from the mean (z = .000) to your particular z value. For 
example, if the z of interest were —1.24, the proportion would be .3925. 
To compute the proportional part of the area in one half of the distribu- 
tion that lies beyond the z value of interest, subtract the number found 
above from .5000. Thus, the area below a z of —1.24 would be .5000 — 
8925 = .1075. 
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Zz .00 -O1 .02 -03 04 05 .06 .07 .08 .09 
0.0 | .0000 .0040 .0080 .0120 .0160 .0199 .0239 .0279 .0319 .0359 
Ont 0398 .0438 .0478 .0517 .0557 .0596 .0636 .0675 .0714 .0753 
0.2 | .0793 .0832 .0871 .0910 .0948 .0987 .1026 .1064 .1103 .1141 
0.3 1179 .1217') .1255— 11298-13831 .1868 =.1406 .1443 .1480 .1517 
0.4 1554 =.1591 .1628 =.1664 .1700 .1736 .1772 .1808 .1844 .1879 
0.5 1915 .1950 .1985 .2019 .2054 .2088 .2123 .2157 .2190 .2224 
0.6 2257 = .2291 1.2324 «2357 12389-2422) 2454 «2486 «2.2517. 2549 
0.7 | .2580 .2611 .2642 .2673 .2704 .2734 .2764 .2794 .2823 .2852 
0.8 | .2881 .2910 .2939 .2967 .2995 .3028 .3051 .3078 .3106 .3133 
0.9 | .3159 .3186 .3212 .3238 .3264 .3289 .3315 .3340 .3365 .3389 
1.0 | .3413 .3438 .3461 .3485 .3508 .3531 .3554 .3577 .3599 .3621 
1.1 | .3643 .3665 .3686 .3708 .3729 .3749 .3770 .3790 .3810 .3830 
1.2 | .3849 .3869 .3888 .3907 .3925 .3944 .3962 .3980 .3997 .4015 
1.3 | .4032 .4049 .4066 .4082 .4099 .4115 .4131 .4147 .4162 .4177 
1.4 4192 .4207 .4222 .4236 .4251 .4265 .4279 .4292 .4306 .4319 
1.5 4332 .4345 .4357 .4370 .4382 .4894 .4406 .4418 .4429 .4441 
6 4452 .4463 .4474 .4484 .4495 .4505 .4515 .4525 .4535 .4545 
1.7 | .4554 .4564 .4573 .4582 .4591 .4599 .4608 .4616 .4625 .4633 
1.8 | .4641 .4649 .4656 .4664 .4671 .4678 .4686 .4693 .4699 .4706 
1.9 | .4713  .4719 .4726 .4732 .4738 .4744 .4750 .4756 .4761 .4767 
2.0 | .4772 .4778 .4783 .4788 .4793 .4798 .4803 .4808 .4812 .4817 
2.1 | .4821 .4826 .4830 .4834 .4838 .4842 .4846 .4850 .4854 .4857 
2.2 | .4861 .4864 .4868 .4871 .4875 .4878 .4881 .4884 .4887 .4890 
2.3 | .4893 .4896 .4898 .4901 .4904 .4906 .4909 .4911 .4913 .4916 
2.4 | .4918 .4920 .4922 .4925 .4927 .4929 .4931 .4932 .4934 .4936 
2.5 4938 .4940 .4941 .4943 .4945 .4946 .4948 .4949 .4951 .4952 
2.6 4953 .4955 .4956 .4957 .4959 .4960 .4961 .4962 .4963 .4964 
Za) 4965 .4966 .4967 .4968 .4969 .4970 .4971 .4972 .4973 .4974 
2.8 4974 .4975 .4976 .4977 .4977 .4978 .4979 .4979 .4980 .4981 
2.9 | .4981 .4982 .4982 .4983 .4984 .4984 .4985 .4985 .4986 .4986 
3.0 | .4987 .4987 .4987 .4988 .4988 .4989 .4989 .4989 .4990 .4990 
3.1 49903 
3.2 49931 
3.3 49952 
3.4 49966 
3.5 49977 
3.6 49984 
St 49989 
3.8 49993 
3.9 49995 
4.0 50000 
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APPENDIX B 
Critical Values of “‘Student’s”’ t Statistic 


To read this table, first find the degrees of freedom (df) in the column 
at the left. The minimum t values for the several alpha levels of significance 
are given in the columns to the right of the df column. Note that the alpha 
levels are given for both directional (one-tailed) and nondirectional (two- 
tailed) tests of significance. Nearly all tests of significance are, however, 
nondirectional. 

To demonstrate the use of this table, assume that a computed ¢ value 
of 3.25 was obtained with df equal to 15. Entering the table at the row 
headed by 15 df, read to the right. Note that the ¢ of 3.25 is larger than 
the .01 value (2.947) for a two-tailed test but less than the .001 value 
(4.073). Therefore, it is concluded that this ¢t value is significant beyond 
the .01 level. 
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Appendix B. t Statistic 
a a Me i Re 


Alpha level of significance for directional (one-tailed) tests 
.25 .05 .025 .O1 .005 .0005 
df SS SS 
Alpha level of significance for nondirectional (two-tailed) tests 


-50 -10 .05 .02 .O1 .001 
1 1.000 6.314 12.706 31.821 63.657 636.619 
2 .816 2.920 4.303 6.965 9.925 31.598 
3 765 2.353 3.182 4.541 5.841 12.941 
4 741 2.132 2.776 3.747 4.604 8.610 
5 727 2.015 2.571 3.365 4.032 6.859 
6 718 1.943 2.447 3.143 3.707 5.959 
7 711 1.895 2.365 2.998 3.499 5.405 
8 706 1.860 2.306 2.896 3.355 5.041 
9 .703 1.833 2.262 2.821 3.250 4.781 
10 .700 1.812 2.228 2.764 3.169 4.587 
11 .697 1.796 2.201 2.718 3.106 4.437 
12 .695 1.782 2.179 2.681 3.055 4.318 
13 .694 Uber! 2.160 2.650 3.012 4.221 
14 .692 1.761 2.145 2.624 2.977 4.140 
15 -691 1.753 2.131 2.602 2.947 4.073 
16 .690 1.746 2.120 2.583 2.921 4.015 
17 .689 1.740 2.110 2.567 2.898 3.965 
18 .688 1.734 2.101 2.552 2.878 3.922 
19 .688 1.729 2.093 2.539 2.861 3.883 
20 .687 1.725 2.086 2.528 2.845 3.850 
21 .686 7A 2.080 2.518 2.831 3.819 
22 .686 LE shy 2.074 2.508 2.819 3.792 
23 .685 1.714 2.069 2.500 2.807 3.767 
24 .685 UL a7(i gl 2.064 2.492 2.797 3.745 
25 .684 1.708 2.060 2.485 2.787 3.725 
26 .684 1.706 2.056 2.479 2.409 3.707 
27 634 1.703 2.052 2.473 2.771 3.690 
28 .683 1.701 2.048 2.467 2.763 3.674 
29 .683 1.699 2.045 2.462 2.756 3.659 
30 .683 1.697 2.042 2.457 2.750 3.646 
40 .681 1.684 2.021 2.423 2.704 3.551 
60 BOLO 1.671 2.000 2.390 2.660 3.460 
120 .677 1.658 1.980 2.358 2.617 3.373 
© .674 1.645 1.960 2.326 2.576 3.291 


SOURCE: Appendix B is taken from Table III of Fisher & Yates: Statistical Tables for Biological, Agricultural 
and Medical Research, published by Oliver & Boyd Ltd., Edinburgh, and by permission of the authors and 
publishers. This abridgment is reproduced from John G. Peatman, Introduction to Applied Statistics. New 
York: Harper & Row, Publishers, 1953. Reprinted by permission. 
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APPENDIX C 
Centile Values of the Chi-Square Statistic 


To read this table, first find the degrees of freedom (df) in the column 
at the left. The minimum chi-square values for the several alpha levels 
are given in the columns to the right of the df column. The subscript 
values for each chi-square column indicate the probability of a real differ- 
ence existing. If you wish to find the probability that the obtained differ- 
ence is due to chance, simply subtract the given subscript value from 1.00, 
e.g., 1.00 — .95 = .05. 

To demonstrate the use of this table, assume that a computed chi- 
square of 25.0 was obtained with 15 df. Entering the table at the row 
headed by 15 df, read to the right. The value of 25.0 is listed in the .95 
column. Thus, it is concluded that the probability is .95 that the difference 
is real, or that the probability is .05 that the difference is due to chance 
alone. 


Appendix C. Chi-Square Statistic 
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APPENDIX D 


Per Cent Points in the F Distribution 


To read this table, the degrees of freedom (df) for both mean-square 
values of the F ratio must be located in the table. The df for the numerator 
is located in the top row (df1). The df for the denominator of the F ratio 
is located in the column to the far left of the table (dfz). The values in the 
block where the row and column intersect represent the F values at differ- 
ent alpha levels of significance. Note that in this table, the alpha levels 
are listed as percentages. To convert to probabilities, simply move the 
decimal point two places to the left. For example, 2.5% is equal to .025. 

To demonstrate the use of this table, assume that a computed F ratio 
of 3.54 was obtained with df equal to 5 and 15. Entering the table by the 
column headed by df; equal to 5 and by the row headed by dfz equal to 
15, we find that the values range from 1.68 for the 20% level (.20) to 7.57 
for the .1% level (.001). The F ratio of 3.54 falls just short of the value 
required for the 2.5% (.025) level. It is concluded, then, that the F of 3.54 
with df equal to 5 and 15 is significant at the 5% (.05) level. 


dfi 
1 2 3 4 5 6 8 12 24 © 
dfe 
1 0.1% | 405284 500000 540379 562500 576405 585937 598144 610667 623497 636619 
0.5% 16211 20000 21615 22500 23056 23437 23925 24426 24940 25465 
Tes 4052 4999 5403 5625 5764 5859 5981 6106 6234 6366 
2.5% | 647.79 799.50 864.16 899.58 921.85 937.11 956.66 976.71 997.25 1018.30 
5 % | 161.45 199.50 215.71 224.58 230.16 233.99 238.88 243.91 249.05 254.32 
10 %G% 39.86 49.50 53.59 55.83 57.24 58.20 59.44 60.70 62.00 63.33 
20 %G% 9.47 912.00 23.06 13.73 14.01 14.26 14.59 14.90 15.24 15.58 
2 0.1 998.5 999.0 999.2 999.2 999.3 999.3 999.4 999.4 999.5 999.5 
0.5 198.50 199.00 199.17 199.25 199.30 199.33 199.37 199.42 199.46 199.51 
ul 98.49 99.00 99.17 99.25 99.30 99.33 99.36 99.42 99.46 99.50 
2.5 38.51 39.00 39.17 39.25 39.30 39.33 39.37 39.42 39.46 39.50 
5 18.51 19.00 19.16 19.25 19.30 19.383 19.37 19.41 19.45 19.50 
10 8.53 9.00 9.16 9.24 9.29 9.33 9.37 9.41 9.45 9.49 
20 3.56 4.00 4.16 4.24 4.28 4.32 4.36 4.40 4.44 4.48 
3 0.1 167.5 "44825 “i4iele Is7 184.6 1382.8 180.8. 128.3. 125.9 123.5 
0.5 55.55 49.80 47.47 46.20 45.39 44.84 44.13 48.39 42.62 41.83 
1 34.12 80.81 29.46 28:71 28.24 27.91 27.49 27.05 26.60 26.12 
4 17.44 16.04 15.44 15.10 14.89 14.74 14.54 14.34 14.12 138.90 
5 10.13 9.55 9.28 9.12 9.01 8.94 8.84 8.74 8.64 8.53 
10 5.54 5.46 5.39 5.34 5.31 5.28 5.25 5.22 5.18 5.13 
20 2.68 2.89 2.94 2.96 2.97 2.97 2.98 2.98 2.98 2.98 
4 0.1 74.14 61.25 56.18 53.44 51.71 50.53 49.00 47.41 45.77 44.05 
0.5 31.338 26.28 24.26 23.16 22.46 21.98 21.35 20.71 20.03 19.33 
1 Zee). 1800'S WGR69)” 5298) 615.520 1523 AALRO 4387 13:03) 13.46 
2.5 12.22 10565, 9.98 9.60 9.36 9.20 8.98 8.75 8.51 8.26 
5 Path 6.94 6.59 6.39 6.26 6.16 6.04 5.91 Sele 5.63 
10 4.54 4.32 4.19 4.11 4.05 4.01 3.95 3.90 3.83 3.76 
20 2.35 2.47 2.48 2.48 2.48 2.47 2.47 2.46 2.44 2.43 
5 0.1 47.04 36.61 33.20 31.09 29.75 28.84 27.64 26.42 25.14 23.78 
0.5 22.79 18.31 16.53 15.56 14.94 14.51 18.96 13.38 12:78 12.14 
1 16.26 18.27 12.06. 11.89 10.97 10.67 10.29 9.89 9.47 9.02 
2.5 10.01 8.43 7.76 7.39 7.15 6.98 6.76 6:52 6.28 6.02 
5 6.61 5.79 5.41 5.19 5.05 4.95 4.82 4.68 4.53 4.36 
10 4.06 3.78 3.62 3.52 3.45 3.40 3.34 3.27 3.19 3.10 
20 2.18 2.26 2.25 2.24 2.23 Dene 2.20 2.18 2.16 2.13 
i Be A a ee 


sourcE: Appendix D is taken from Table V of Fisher & Yates: Statistical Tables for Biological, Agricultural 
and Medical Research, published by Oliver & Boyd Ltd., Edinburgh, and by permission of the authors and 
publishers. This abridgment is reproduced from E. F. Lindquist, Design and Analysis of Experiments in 
Psychology and Education. Boston: Houghton Mifflin Company, 1953. Reprinted by permission. 
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Appendix D. F Distribution (cont.) 


dfi 
1 2 3 4 5 6 8 12 24 oo 
afr 

6 0.1% 35.51 27.00 23.70 21.90 20.81 20.03 19.03 17.99 16.89 15.75 
0.5% 18.64 14.54 12.92 12.03 11.46 11.07 10.57 10.03 9.47 8.88 
lie 13.74 10.92 9.78 9.15 8.75 8.47 8.10 Cuda 7.31 6.88 
2.5% 8.81 7.26 6.60 6.23 5.99 5.82 5.60 5.37 5.12 4.85 
52% 5.99 5.14 4.76 4.53 4.39 4.28 4.15 4.00 3.84 3.67 
10 % 3.78 3.46 3.29 3.18 3.11 3.05 2.98 2.90 2.82 2.72 
20 % 2.07 2.13 2.11 2.09 2.08 2.06 2.04 2.02 1.99 1.95 
if 0.1 29.22 21.69 18.77 17.19 16.21 15.52 14.63 13.71 13.73 11.69 
O25 16.24 12.40 10.88 10.05 9.52 9.16 8.68 8.18 7.65 7.08 
1 12.25 9.55 8.45 7.85 7.46 7.19 6.84 6.47 6.07 5.65 
2.5 8.07 6.54 5.89 5.52 5.29 5.12 4.90 4.67 4.42 4.14 
5 5.59 4.74 4.35 4.12 3.97 3.87 3.73 3.57 3.41 3.23 
10 3.59 3.26 3.07 2.96 2.88 2.83 2.75 2.67 2.58 2.47 
20 2.00 2.04 2.02 1.99 1.97 1.96 1,93 1.91 1.87 1.83 
8 0.1 25.42 18.49 15.83 14.39 13.49 12.86 12.04 11.19 10.30 9.34 
O25 14.69 11.04 9.60 8.81 8.30 1295 7.50 7.01 6.50 5.95 
1 11.26 8.65 7.59 7.01 6.63 6.37 6.03 5.67 5.28 4.86 
2.5 (ORGY f 6.06 5.42 5.05 4.82 4.65 4.43 4.20 3.95 3.67 
5 5.32 4.46 4.07 3.84 3.69 3.58 3.44 3.28 3.12 2.93 
10 3.46 3.11 2.92 2.81 2.73 2.67 2.59 2.50 2.40 2.29 
20 1.95 1.98 1.95 1.92 1.90 1.88 1.86 1.83 1.79 1.74 
9 0.1 22.86 16.39 13.90 12.56 11.71 11.13 10.37 9.57 8.72 7.81 
0.5 13.61 10.11 8.72 7.96 7.47 7.13 6.69 6.23 Suro 5.19 
a 10.56 8.02 6.99 6.42 6.06 5.80 5.47 5.11 4.73 4.31 
2.5 7.21 §.71 5.08 4.72 4.48 4.32 4.10 3.87 3.61 3.33 
5 5.12 4.26 3.86 3.63 3.48 3.37 3.23 3.07 2.90 PIAA: 
10 3.36 3.01 2.81 2.69 2.61 2.55 2.47 2.38 2.28 2.16 
20 1.91 1.94 1.90 1.87 P85 1.83 1.80 1.76 1.72 1.67 
10 0.1 21.04 14.91 12.55 11.28 10.48 9.92 9.20 8.45 7.64 6.76 
0.5 12.83 9.43 8.08 7.34 6.87 6.54 6.12 5.66 Died 4.64 
1 10.04 7.56 6.55 5.99 5.64 5.39 5.06 4.71 4.33 3.91 
2.5 6.94 5.46 4.83 4.47 4.24 4.07 3.85 3.62 3.37 3.08 
5 4.96 4.10 Eve! 3.48 3.33 Siewe: 3.07 2.91 2.74 2.54 
10 3.28 2.92 outs 2.61 2.52 2.46 2.38 2.28 2.18 2.06 
20 1.88 1.90 1.86 1.83 1.80 1.78 eno L472 1.67 1.62 
11 0.1 19.69 13.81 11.56 10.35 9.58 9.05 8.35 1.63 6.85 6.00 
0.5 12.23 8.91 7.60 6.88 6.42 6.10 5.68 5.24 4.76 4.23 
1 9.65 120 6.22 5.67 5.32 5.07 4.74 4.40 4.02 3.60 
2.5 6.72 5.26 4.63 4.28 4.04 3.88 3.66 3.43 3.17 2.88 
5 4.84 3.98 3.59 3.36 3.20 3.09 2.95 2.79 2.61 2.40 
10 3.23 2.86 2.66 2.54 2.45 2.39 2.30 2.21 2.10 1.97 
20 1.86 1.87 1.83 1.80 Lat 1.75 L.72 1.68 1.63 L5z 
12 0.1 18.64 12.97 10.80 9.63 8.89 8.38 inva 7.00 6.25 5.42 
0.5 11.75 8.51 7.23 6.52 6.07 5.76 5.35 4.91 4.43 3.90 
1 9.33 6.93 5.95 5.41 5.06 4.82 4.50 4.16 3.78 3.36 
2.5 6.55 5.10 4.47 4.12 3.89 ee? 3.51 3.28 3.02 2.02 
5 4.75 3.88 3.49 3.26 3.11 3.00 2.85 2.69 2.50 2.30 
10 3.18 2.81 2.61 2.48 2.39 2.33 2.24 2.15 2.04 1.90 
20 1.84 1.85 1.80 LB § 1.74 14 1.69 1.65 1.60 1.54 
13 Oe 17.81 12.31 10.21 9.07 8.35 7.86 (ep 6.52 5.78 4.97 
0.5 11.37 8.19 6.93 6.23 5.79 5.48 5.08 4.64 4.17 3.65 
I 9.07 6.70 5.74 5.20 4.86 4.62 4.30 3.96 3.59 3.16 
Zid 6.41 4.97 4.35 4.00 Ce Oh 3.60 3.39 3.15 2.89 2.60 
5 4.67 3.80 3.41 3.18 3.02 2.92 7 OY if 2.60 2.42 Zeek 
10 3.14 2.76 2.56 2.43 2.35 2.28 2.20 2.10 1.98 1.85 
20 1.82 1.83 1.78 L775 1.72 1.69 1.66 1.62 LB 1.51 
14 OF 17.14 11.78 9.73 8.62 7.92 7.43 6.80 6.13 5.41 4.60 
0.5 11.06 7.92 6.68 6.00 5.56 5.26 4.86 4.43 3.96 3.44 
J 8.86 6.51 5.56 5.03 4.69 4.46 4.14 3.80 3.43 3.00 
Zao 6.30 4.86 4,24 3.89 3.66 3.50 3.29 3.05 2.79 2.49 
5 4.60 3.74 3.34 3.11 2.96 2.85 2.70 2.53 2.35 2.13 
10 3.10 2.73 2.52 2.39 2.31 2.24 2215 2.05 1.94 1.80 
20 1.81 1.81 1.76 1.73 1.70 1.67 1.64 1.60 1.55 1.48 
15 0.1 16.59 11.34 9.34 8.25 7,57 7.09 6.47 5.81 5.10 4.31 
0.5 10.80 aatO 6.48 5.80 "DOT 5.07 4.67 4.25 3.79 3.26 
1 8.68 6.36 5.42 4.89 4.56 4.32 4.00 3.67 3.29 2.87 
2.5 6.20 4.77 4.15 3.80 3.58 3.41 3.20 2.96 2.70 2.40 
5 4.54 3.68 3.29 3.06 2.90 2.79 2.64 2.48 2.29 2.07 
10 3.07 2.70 2.49 2.36 2.27 Pp) | 2.12 2.02 1.90 1.76 
20 1.80 1.79 1.75 vat 1.68 1.66 1.62 1.58 1.53 1.46 
LT 
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Appendix D. F Distribution (cont.) 


dfi 
1 Z 3 4 5 6 8 12 24 © 
dfs 
16 0.1% 16.12 10.97 9.00 7.94 Vere 6.81 6.19 5.55 4.85 4.06 
0.5% 10.58 col 6.30 5.64 §.21 4.91 4.52 4.10 3.64 3.11 
4 8.53 6.23 5.29 4.77 4,44 4.20 3.89 3.55 3.18 2.45 
2.5% 6.12 4.69 4.08 3.73 3.50 3.34 3.12 2.89 2.63 2.32 
oy 4.49 3.63 3.24 3.01 2.85 2.74 2.59 2.42 2.24 2.01 
TOME, 3,05 2.67 2.46 2.33 2.24 2.18 2.09 1.99 oY g 1.72 
20 % 1.79 1.78 1.74 1.70 1.67 1.64 1.61 1.56 1.51 1.43 
us 0.1 15.72 10.66 8.73 7.68 7.02 6.56 5.96 5.32 4.63 3.85 
0.5 10.38 7.35 6.16 5.50 5.07 4.78 4.39 3.97 3.51 2.98 
1 8.40 6.11 5.18 4.67 4.34 4.10 3.79 3.45 3.08 2.65 
2.5 6.04 4.62 4.01 3.66 3.44 3.28 3.06 2.82 2.56 2.25 
5 4.45 3.59 3.20 2.96 2.81 2.70 2.55 2.38 2.19 1.96 
10 3.03 2.64 2.44 2.31 2.22 2.15 2.06 1.96 1.84 1.69 
20 1.78 die 1.72 1.68 1.65 1.63 1.59 1.55 1.49 1.42 
18 On 15.38 10.39 8.49 7.46 6.81 6.35 5.76 5.13 4.45 3.67 
0.5 10.22 7.21 6.03 5.37 4.96 4.66 4.28 3.86 3.40 ps Ff 
il 8.28 6.01 5.09 4.58 4.25 4.01 3.71 3.37 3.00 2.57 
2.5 5.98 4.56 3.95 3.61 3.38 3.22 3.01 2.77 2.50 2.19 
5 4.41 3.55 3.16 2.93 ie i 2.66 2.51 2.34 2.15 1.92 
10 3.01 2.62 2.42 2.29 2.20 2.13 2.04 1.93 1.81 1.66 
20 1.77 1.76 eel. 1.67 1.64 1.62 1.58 1.53 1.48 1.40 
19 0.1 15.08 10.16 8.28 7.26 6.61 6.18 5.59 4.97 4.29 3.52 
0.5 10.07 7.09 5.92 S28 4.85 4.56 4.18 3.76 3.31 2.78 
1 8.18 5.93 5.01 4.50 4.17 3.94 3.63 3.30 2.92 2.49 
2.5 5.92 4.51 3.90 3.56 3.33 sae 4 2.96 2.72 2.45 2.13 
5 4.38 3.52 3.13 2.90 2.74 2.63 2.48 2.31 2.11 1.88 
10 2.99 2.61 2.40 2.28 2.18 2.11 2.02 1.91 1.79 1.63 
20 1.76 1.75 1.70 1.66 1.63 1.61 1.57 1.52 1.46 1.39 
20 0.1 14.82 9.95 8.10 Z<i0 6.46 6.02 5.44 4.82 4.15 3.38 
0.5 9.94 6.99 5.82 5.17 4.76 4.47 4.09 3.68 3.22 2.69 
1 8.10 5.85 4.94 4.43 4.10 3.87 3.56 3.23 2.86 2.42 
2.5 5.87 4.46 3.86 3.51 3.29 3.13 2.91 2.68 2.41 2.09 
5 4.35 3.49 3.10 YG 2.01 2.60 2.45 2.28 2.08 1.84 
10 2.97 2.59 2.38 2.25 2.16 2.09 2.00 1.89 Loge 1.62 
20 76 1.75 1.70 1.65 1.62 1.60 1.56 1.51 1.45 1.37 
21 0.1 14.59 9.77 7.94 6.95 6.32 5.88 5.31 4.70 4.03 3.26 
0.5 9.83 6.89 5.73 5.09 4.68 4.39 4.01 3.60 3.15 2.62 
1 8.02 5.78 4.87 4.37 4.04 3.81 3.51 sia 2.80 2.36 
Pe seias 5.83 4.42 3.82 3.48 3.25 3.09 2.87 2.64 2.30 2.04 
5 4.32 3.47 3.07 2.84 2.68 3.50 2.42 2.25 2.05 1.81 
10 2.96 2.07 2.36 2.23 2.14 2.08 1.98 1.88 L.zS 1.59 
20 1.75 1.74 1.69 1.65 1.61 1.59 1.55 1.50 1.44 1.36 
22 0.1 14.38 9.61 7.80 6.81 6.19 5.76 5.19 4.58 3.92 3.15 
0.5 9.73 6.81 5.65 5.02 4.61 4.32 3.94 3.54 3.08 2.55 
1 7.94 5.72 4.82 4.31 3.99 3.76 3.45 3.12 2.75 2.31 
2.5 5.79 4.38 3.78 3.44 3.22 3.05 2.84 2.60 2.33 2.00 
5 4.30 3.44 3.05 2.82 2.66 2.55 2.40 2.23 2.03 1.78 
10 2.95 2.56 2.35 2.22 2.13 2.06 1.97 1.86 1.73 1.5% 
20 i AS) 1.73 1.68 1.64 1.61 1.58 1.54 1.49 1.43 1.35 
23 0.1 14.19 9.47 7.67 6.69 6.08 5.65 5.09 4.48 3.82 3.05 
0.5 9.63 6.73 5.58 4.95 4.54 4.26 3.88 3.47 3.02 2.48 
1 7.88 5.66 4.76 4.26 3.94 3.71 3.41 3.07 2.70 2.26 
2.5 5.15 4.35 3.75 3.41 3.18 3.02 2.81 2 .5¢ 2.30 1.97 
5 4.28 3.42 3.03 2.80 2.64 2.53 2.38 2.20 2.00 <6 
10 2.94 2.55 2.34 2.21 ee | 2.05 1.95 1.84 1.72 1.55 
20 1.74 1.73 1.68 1.63 1.60 Tey 1.53 1.49 1.42 1.34 
24 0.1 14.03 9.34 7.55 6.59 5.98 5.55 4.99 4.39 3.74 2.97 
0.5 9.55 6.66 §.52 4.89 4.49 4.20 3.83 3.42 2.97 2.43 
1 7.82 5.61 4.72 4.22 3.90 3.67 3.36 3.03 2.66 2.21 
2.5 5.72 4.32 3.72 3.38 3.15 2.99 2.78 2.54 2.27 1.94 
5 4.26 3.40 3.01 2.78 2.62 2.51 2.36 2.18 1.98 1.73 
10 2.93 2.54 2.33 2.19 2.10 2.04 1.94 1.83 1.70 1.53 
20 1.74 iia! 1.67 1.63 1.59 MSY g 1.53 1.48 1.42 1.33 
20, 0.1 13.88 9.22 7.45 6.49 5.88 5.46 4.91 4.31 3.66 2.89 
0.5 9.48 6.60 5.46 4.84 4.43 4.15 3.78 Seoe 2.92 2.38 
1 COL 5.57 4.68 4.18 3.86 3.63 3.32 2.99 2.62 DubT 
2.5 5.69 4.29 3.69 3.35 3.13 2.97 2.75 2.08 2.24 1.91 
5 4.24 3.38 2.99 2.76 2.60 2.49 2.34 2.16 1.96 arg 
10 2.92 2,53 2.32 2.18 2.09 2.02 1.93 1.82 1.69 1.52 
20 1.73 1.72 1.66 1.62 1.59 1.56 1.52 1.47 1.41 1.32 
re ee eee 


Appendix D. F Distribution (cont.) 
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dfi 
1 2 3 4 [ 6 8 12 24 a 
dfe 

26 0.1% 13.74 9.12 7.36 6.41 5.80 5.38 4.83 4.24 3.59 2.82 
0.5% 9.41 6.54 5.41 4.79 4.38 4.10 3.73 3.33 2.87 2.33 
Leas vee be 5.53 4.64 4.14 3.82 3.59 3.29 2.96 2.58 2.13 
2.5% 5.66 4.27 3.67 3.33 3.10 2.94 2.73 2.49 2.22 1.88 
5 G 4,22 3.37 2.98 2.74 2.59 2.47 2.32 2.15 1.95 1.69 
10 0 2.91 2752 2.31 217 2.08 2.01 1.92 1.81 1.68 1.50 
20 1.73 ) yal 1.66 P62 1.58 1.56 1552 1.47 1.40 1.31 
27 0.1 13.61 9.02 OP LE 6.33 §.73 5.31 4.76 4.17 3.52 yar bs) 
0.5 9.34 6.49 5.36 4.74 4.34 4.06 3.69 3.28 2.83 2.29 
1 7.68 5.49 4.60 4.11 3.78 3.56 3.26 2.93 2255 2.10 
2.5 5.63 4.24 3.65 3.31 3.08 2.92 20 2.47 2.19 1.85 
sy 4.21 3.35 2.96 2.43 2.50 2.46 2.30 2.13 1.93 1.67 
10 2.90 2.51 2.30 2.17 2.07 2.00 1.91 1.80 1.67 1.49 
20 1.73 et 1.66 1.61 1.58 155: 1.51 1.46 1.40 1.30 
28 0.1 13.50 8.93 7.19 6.25 5.66 eae 4.69 4.11 3.46 2.70 
0.5 9.28 6.44 bey 4.70 4.30 4.02 3.65 3.25 2.79 220 
1 7.64 5.45 4.57 4.07 3.75 3.53 3.23 2.90 2.52 2.06 
2.5 5.61 4,22 3.63 3.29 3.06 2.90 2.69 2.45 Boe 1.83 
5 4.20 3.34 2.95 aay Al 2206 2.44 2.29 2.12 1.91 165 
10 2.89 2.50 2.29 2.16 2.06 2.00 1.90 1.79 1.66 1.48 
20 Le Lae 1.65 1.61 yg 1.55 Lebt 1.46 1.39 1.30 
29 0.1 13.39 8.85 wale 6.19 5.59 5.18 4.64 4.05 3.41 2.64 
0.5 9.23 6.40 5.28 4.66 4.26 3.98 3.61 3.21 2.76 2,21 
i! 7.60 5.42 4.54 4.04 3.73 3.50 3.20 2.87 2.49 2.03 
225 5.59 4.20 3.61 Sra 3.04 2.88 2.67 2.43 2.15 1.81 
5 4.18 3.33 2.93 2.70 2.54 2.43 2.28 2.10 1.90 1.64 
10 2.89 2.50 2.28 2.15: 2.06 1.99 1.89 1.78 1.65 1.47 
20 £2 1.70 1.65 1.60 1 lay 1.54 1.50 1.45 1.39 1.29 
30 OF} 13.29 8.77 7.05 6.12 5.53 5.12 4.58 4.00 3.36 2.59 
0.5 9.18 6.35 5.24 4.62 4.23 3.95 3.58 3.18 2.73 2.18 
1 7.56 5.39 4.51 4.02 3.70 3.47 Bey Wd 2.84 2.47 2.01 
25 § .8F 4.18 3.59 3.25 3.03 QSG 2.65 2.41 2.14 1.79 
5 4.17 3.32 2.92 2.69 2.53 2.42 eat 2.09 1.89 1.62 
10 2.88 2.49 2.28 2.14 2.05 1.98 1.88 iksréce 1.64 1.46 
20 Live 1.70 1.64 1.60 IW Y6 1.54 1.50 1.45 1.38 1.28 
40 0.1 12.61 8.25 6.60 5.70 5.13 4.73 4,21 3.64 3.01 2.23 
0.5 8.83 6.07 4.98 4.37 3.99 ip fi 3.35 2.95 2.50 1.93 
1 7.31 5.18 4.31 3.83 3.51 3.29 2.99 2.66 2.29 1.80 
24 5.42 4.05 3.46 3.13 2.90 2.74 2.53 2.29 2.01 1.64 
5 4.08 3.23 2.84 2.61 2.45 2.34 2.18 2.00 1.79 PS5L 
10 2.84 2.44 2.23 2.09 2.00 1.93 1.83 seat tor 1.38 
20 1.70 1.68 1.62 1.57 1.54 Por 1.47 1.41 1.34 1.24 
60 0.1 11.97 7.76 6.17 5.31 4.76 4.37 3.87 3.31 2.69 1.90 
0.5 8.49 5.80 4.73 4.14 3.76 3.49 3.13 2.74 2.29 1.69 
1 7.08 4.98 4.13 3.65 3.34 3.12 2.82 2.50 2.12 1.60 
P25 5.29 3.93 3.34 3.01 2.79 2.63 2.41 Gm Nd 1.88 1.48 
5 4.00 3.15 2.76 202 2.37 Dene 2.10 1.92 1.70 1.39 
10 2.79 2.39 7 Jes Be 2.04 1.95 1.87 LvZ 1.66 Lol 1.29 
20 1.68 1.65 1.59 1.55 1.51 1.48 1.44 1.38 1.31 1.18 
120 0.1 11.38 7.01 5.79 4.95 4.42 4.04 SOD. 3.02 2.40 1.56 
O75 8.18 5.54 4.50 3:92 3.00 3.28 2.93 2.54 2.09 1.43 
i 6.85 4.79 3.95 3.48 3.17 2.96 2.66 2.34 1.95 1.38 
2.5 5.15 3.80 3.23 2.89 2.67 2.52 2.30 2.05 176 fon 
5 3.92 3.07 2.68 2.45 2.29 2.17 2.02 1.83 1.61 1.25 
10 2.75 2.35 2.13 1.99 1.90 1.82 t 72 1.60 1.45 1.19 
20 1.66 1.63 1.5¢ 1.52 1.48 1.45 1.41 1.35 76 1.12 
fos) 0.1 10.83 6.91 5.42 4.62 4.10 3.74 S20 2.74 2.13 1.00 
0.5 7.88 5.30 4,28 Sate 3.35 3.09 2.74 2.36 1.90 1.00 
1 6.64 4.60 3.78 3.32 3.02 2.80 2.51 2.18 1.79 1.00 
2.5 5.02 3.69 Sale, 2.79 PAR YG 2.41 2.19 1.94 1.64 1.00 
5 3.84 2.99 2.60 2.37 2.21 2.09 1.94 1.75 1.52 1.00 
10 2.71 2.30: 2.08 1.94 1.85 i ey ig 1.67 1.55 1.38 1.00 
20 1.64 1.61 1.55 1.50 1.46 1.43 1.38 1.32 1.23 1.00 
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APPENDIX E 


Fisher’s z-Transformation Function for Pearson’s r Correlation 


Coefficient: z = 3 [log. (1 + r) — log, (1 — r)] 


To read this table, simply find the correlation coefficient value in the 
r column and then read the corresponding Z value from the adjacent 
column. For example, if the r value were .46, the Z would be .497. 


Appendix E. Fisher’s s Transformation 


ip Z 
000 | .000 
005 | .005 
010 | .010 
015 | .015 
020 | .020 
025 | .025 
030 | .030 
-035.| .035 
.040 | .040 
045 | .045 
050 | .050 
055 | .055 
060 | .060 
065 | .065 
070 | .070 
075 | .075 
080 | .080 
.085 | .085 
.090 | .090 
095 ; .095 
100 | .100 
105 105 
110 110 
115 116 
120 121 
125 126 
130 131 
135 136 
.140 141 
145 146 
LEON) a tap | 
155 | .156 
160 | .161 
165 | .167 
HOO CZ, 
Bom had 
.180 | .182 
.185 | .187 
.190 | .192 
.195 | .198 


.300 
305 
.310 
315 
.320 


.325 
.330 
.335 
.340 
.345 


.350 
.300 
.360 
.365 
.370 


375 
.380 
.385 
.390 
-395 


282 
. 288 
.293 
.299 
304 


.310 
.315 
.o21 
.326 
.332 


-337 
.343 
.348 
354 
.360 


365 
.371 
377 
.383 
. 988 


.394 
.400 
.406 
.412 
.418 


- 550 
.555 
.560 
.565 
.570 


.575 
. 580 
.585 
.590 
.595 


— 


1 
1 
1 
1 
1 


-918 
.929 
.940 
.950 
. 962 


973 
. 984 
- 996 
.008 
.020 


-033 
.045 
.058 
.071 
.085 


NNR ee eee ee a re ee ao 


NON N bd bw 
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.946 
.014 
.092 


185 
298 


.443 


647 
994 


souRCcE: From Statistical Methods by Allen L. Edwards. Copyright 1954, © 1967 by Allen L. Edwards. 


Reprinted by permission of Holt, Rinehart & Winston, Inc. 
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APPENDIX F 


Critical Values of Pearson’s r Correlation Coefficient for Five Alpha 


Significance Levels 


To read this table, find the appropriate degrees of freedom for the 
correlation coefficient in the column headed by n’ — 2. When this value 
has been located, read to the right to find the values that represent the 
minimum 7 values for significance at the .10, .05, .02, .01, and .001 alpha 
levels of significance. For example, if the degrees of freedom were 25, an 
r of at least .3233 would be needed for significance at the .10 level, .3809 
at the .05 level, etc. 


229 


Appendix F. Pearson’s r 


n' — 2 10 -05 .02 -O1 -001 
1 . 98769 . 99692 - 999507 .999877 . 9999988 
2 . 90000 - 95000 . 98000 . 990000 . 99900 
3 -8054 -8783 .93433 -95873 .99116 
4 .7293 .8114 .8822 .91720 . 97406 
5 .6694 7545 .8329 .8745 . 95074 
6 .6215 . 7067 . 1887 .8343 . 92493 
7 . 5822 .6664 . 7498 7977 .8982 
8 .5494 .6319 .7155 . 7646 8721 
9 .5214 -6021 -6851 . 7348 8471 

10 .4973 .5760 .6581 3 AOD .8233 
11 -4762 .5529 .6339 .6835 -8010 
12 .4575 . 5324 .6120 .6614 . 7800 
13 .4409 .5139 .5923 .6411 -7603 
14 .4259 .4973 5742 .6226 . 7420 
15 .4124 4821 .0977 .6055 . 7246 
16 . 4000 -4683 5425 .5897 - 7084 
17 . 3887 .4555 .5285 .5751 -6932 
18 .3783 .4438 -5155 .5614 .6787 
19) . 3687 .4329 5034 . 5487 -6652 
20 . 3598 .4227 .4921 .5368 -6524 
25 .3233 . 3809 -4451 .4869 5974 
30 . 2960 3494 .4093 4487 5041 
35 . 2746 . 3246 .3810 .4182 .5189 
40 .2573 . 3044 .3978 .3932 .4896 
45 . 2428 .2875 3084 .3721 .4648 
50 . 2306 .2732 .3218 35041 4433 
60 .2108 . 2500 . 2948 .3248 .4078 
70 . 1954 .2319 .2737 .3017 .3799 
80 . 1829 .2172 .2565 . 2830 .3568 
90 .1726 . 2050 . 2422 2673 .3375 
100 . 1638 . 1946 .2301 . 2540 3211 


sourcE: Appendix F is taken from Table VI of Fisher & Yates: Statistical Tables for Biological, Agricultural 
and Medical Research, published by Oliver & Boyd Ltd., Edinburgh, and by permission of the authors and 
publishers. 
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APPENDIX G 
Critical Values of the U Statistic of the Mann-Whitney Test 


To read this table, the number of cases in both groups must be lo- 
cated in the particular subtable that lists the level of significance desired 
with either a one-tailed or a two-tailed test. Assume that you wish to find 
the critical value using a two-tailed test at the .05 level of significance. To 
do this, the first step is to locate n; and nz in subtable “‘c.”” The point at 
which the mi row and the m2 column intersect represents the maximum 
critical value for significance at the .05 level. If, for example, n; equals 10, 
nm, equals 15, and the computed value equals 23, it is concluded that the 
difference between the groups is significant—i.e., the tabled critical value 
for ni = 10 and v2 = 15 is 39, and 23 is obviously smaller than 39. 


(a) Critical Values of U for a One-Tailed Test at .001 or for a 
Two-Tailed Test at .002 


N2 
\ [$a um mf we ow se » 
nN 


il 

2 

3 0 0 0 0 
4 0 0 0 1 1 1 2 2 3 3 3 
5 1 il 2 2 3 3 4 5 5 6 7 a 
6 2 3 4 4 5 6 ff 8 9 10 a 12 
7 3 5 6 7 8 9 10 11 13 14 15 16 
8 5 6 8 9 11 12 14 ih ale 18 20 21 
9 A 8 10 12 14 15 17 19 21 3 25 26 


10 8 10 12 14 17 19 21 23 25 27 29 32 


13 14 17 20 23 26 29 32 35 38 42 45 48 
14 15 19 22 25 29 32 36 39 43 46 50 54 
15 tl 21 24 28 32 36 40 43 47 51 55 59 
16 19 23 27 31 35 39 43 48 52 56 60 65 
17 21 25 29 34 38 43 47 52 57 61 66 70 
18 23 27 32 37 42 46 51 56 61 66 71 76 
19 25 29 34 40 45 50 55 60 66 71 77 82 
20 26 32 37 42 48 54 59 65 70 76 82 88 


—__ererereeeeeeeee—————————— 


sourcE: Adapted and abridged from Tables 1, 3, 5, and 7 of D. Aube, “Extended Tables for the Mann- 
Whitney Statistic,” Bulletin of the Institute of Educational Research at Indiana University, 1953, 1, No. 2. 
Reproduced from S. Siegel, Nonparametric Statistics for the Behavioral Sciences. New York: McGraw-Hill 
Book Company, 1956. Reprinted by permission of the Institute of Educational Research and McGraw-Hill 
Book Company. 


Appendix G. U Statistic (cont.) 


Ne 


(b) Critical Values of U for a One-Tailed Test at .01 or for a 


Two-Tailed Test at .02 


9 10 11 12 13 14 15 16 17 18 19 
m 

1 
2 0 0 0 0 0 0 1 
3 1 1 1 2 2 2 3 3 4 4 4 
4 3 3 4 5 5 6 7 7 8 9 9 
5 5 6 7 8 9 10 Bt 12 13 14 15 
6 7 8 9 11 12 13 15 16 18 19 20 
7 9 11 12 14 16 17 19 21 23 24 26 
8 ii 13 15 17 20 22 24 26 28 30 32 
9 14 16 18 21 23 26 28 31 33 36 38 
10 16 19 22 24 27 30 33 36 38 41 44 
11 18 22 25 28 31 34 37 Al 44 47 50 
12 21 24 28 31 35 38 42 46 49 53 56 
13 23 20 31 35 39 43 47 51 55 59 63 
14 26 30 34 38 43 47 51 56 60 65 69 
15 28 33 37 42 47 51 56 61 66 70 75 
16 31 36 Al 46 51 56 61 66 7a 76 82 
17 33 38 44 49 55 60 66 71 77 82 88 
18 36 41 47 53 59 65 70 76 82 88 94 
19 38 44 50 56 63 69 75 82 88 94 101 
20 40 47 53 60 67 73 80 87 93 100 107 
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20 
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Appendix G. U Statistic (cont.) 


(c) Critical Values of U for a One-Tailed Test at .025 or for a 
Two-Tailed Test at .05 


x 9 10 11 12 13 14 15 16 17 18 19 20 
mM 
1 
2 0 0 1 il 1 1 1 1 2 2 2 2 
3 2 3 3 4 4 5 5 6 6 7 7 8 
4 4 5 6 Zi 8 9 10 11 11 12 13 13 
5 7 8 9 11 12 13 14 15 17 18 19 20 
6 10 11 13 14 16 17 19 21 22 24 25 27 
af 12 14 16 18 20 22 24 26 28 30 32 34 
8 15 17 19 22 24 26 29 31 34 36 38 41 
9 17 20 23 26 28 31 34 37 39 42 45 48 
10 20 23 26 29 33 36 39 42 45 48 52 55 
11 23 26 30 30 37 40 44 47 51 55 58 62 
12 26 29 33 37 41 45 49 53 57 61 65 69 
13 28 33 37 41 45 50 54 59 63 67 72 76 
14 31 36 40 45 50 55 59 64 67 74 78 83 
15 34 39 44 49 54 59 64 70 75 80 85 90 
16 37 42 47 53 59 64 tf 75 81 86 92 98 
i 39 45 51 57 63 67 75 81 87 93 99 105 
18 42 48 55 61 67 74 80 86 93 99 106 112 
19 45 52 58 65 72 78 85 92 995 106— 1138 119 
20 48 55 62 69 76 83 90 OS) OoT sa O27 


Appendix G. U Statistic (cont.) 


(d) Critical Values of U for a One-Tailed Test at .05 or for a 
Two-Tailed Test at .10 
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nm 


Ne 


a 10 11 12 13 14 15 16 ve 18 19 20 

1 0 0 
2 1 1 1 2 2 2 3 3 3 4 4 4 
3 3 4 5 5 6 7 7 8 9 9 10 11 
4 6 7 8 9 10 11 12 14 15 16 17 18 
5 o 11 12 13 15 16 18 19 20 22 23 25 
6 12 14 16 17 19 21 23 25 26 28 30 32 
i 15 17 19 21 24 26 28 30 33 35 37 39 
8 18 20 23 26 28 31 33 36 39 41 44 47 
9 21 24 27 30 33 36 39 42 45 48 51 54 
10 24 27 31 34 37 41 44 48 51 55 58 62 
11 27 31 34 38 42 46 50 54 57 61 65 69 
12 30 34 38 42 47 51 55 60 64 68 72 77 
13 33 37 42 47 51 56 61 65 70 75 80 84 
14 36 41 46 51 56 61 66 71 77 82 87 92 
15 39 44 50 55 61 66 72 77 83 88 94 100 
16 42 48 54 60 65 71 77 83 89 95) 101) 107 
17 45 51 57 64 70 aff 83 89 96 102 109 115 
18 48 55 61 68 75 82 88 95 102 109 116 123 
19 51 58 65 72 80 87 94 101 109 116 123 #180 
20 54 62 69 77 84 92 100 107 115 123 130 #138 
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APPENDIX H 


Critical Values for Hartley’s Maximum F-Ratio Significance Test 


for Homogeneity of Variances 


Since the sample size in all groups is the same, the df column repre- 
sents the value for each group. To use this table, simply locate the ap- 
propriate df row heading and the column headed by the number of variances 
that are being compared; then read the value from the point at which the 
row and column intersect. For example, assume that the df of each sample 
is 20, that six variances were compared, and that the Fyox ratio is 4.2. 
Entering the table at the row headed by 20 df and reading across to the 
k = 6 column, it is noted that the .05 value is 3.76 and the .01 value is 
4.9. Therefore, the Fngx = 4.2 is considered significant at the .05 level. 
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Appendix H. F,,,x Statistic 


Alpha = .05 and .07 (in italics) 


Zale So.0 BST vos 142. 9202) 922665. Sse 4032 475-2 550, 626. 8704. 
199. 448. 729. 1086. 1862. 1705. 2068. 2482. 2813. 8204. 3606. 


3| 15.4 27.8 39.2 50.7 62.0 72.9 83.5 93.9 104. 114. 124. 
HIRO HSO2) LL OT LOhe™ CLGeT MeL O te OST et. (SIQRt S37 t anSO le © 


4 9.60 15.5 20.6 25.2 29.5 33.6 37.5 41.1 44.6 48.0 651.4 
23.2 37. 49. 59. 69. 79. 89. Gi SLOG LIS. S120. 


5 foto OL Ss 1d BIG oe eel Oaah BOOS mn OnmeD4. (ame 20R OMe ice ZOO 
14.9 22. 28. 33. 38. 42. 46. 60. 54. 67. 60. 


6 5582p Sya5 1054. 120s) AS i7el 5 0e 16.3) 4175s SAS Ge 19a 2087, 
DUT TET I Se foe 22 a OM 7 26. a7. 30. 32. 3h. 36. 37. 


vs 4.99 6.94 8.44 9.70 10.8 11-8 12.7 13:5 914733" 15.1 “15:8 
8.69 12-1 A%6 16.6 18.420: 22. 23. 24. 26. ae 


8 4°43) 600) -7.18 > 98212, 9 03 Oe7S 10; ae et I ae ie las 
TOO 9.9 sldet 1S.2. el fn ORM LOL S mel G39) Melo) el Od amor mene de 


9 4.03" 6.846.381 Well) 7.80) 38:41 8:95" 9-45 9291 1053 10.7 
6.54 8.6 OSD Te ele Oe OI teed LOO mal O.OmeLO'.0, 


10 o.d2 94.85 5.67 6764 6:92) (2425 97580, 8:28) 78.66, 9201) 19734 
6.85 7.4 8.6 P5610. fel ee Le Oh oa fle O elon 4 elo, 


12 3.28 4.16 4.79 5.380 5.72 6.09 6.42 6.72 7.00 7.25 7.48 
Weole  Oat 6.9 7.6 8.2 8.7 9.1 9.6 9.9 10.2 10.6 


15 2.86 3.54 4.01 4.37 4.68 4.95 5.19 5.40 5.59 5.77 5.98 
407 | 4.2 6.6 6.0 6.4 Gol. (had Ved: 7.6 7.8 8.0 


20 2.46 2.95 3.29 3.54 3.76 3.94 4.10 4.24 4.37 4.49 4.59 
3.382 3.8 4.3 4.6 4.9 6.1 6.3 6.6 5.6 6.8 5.9 


30 207 9240. 261 2788) 20908) 302d cesar 290 io. d08 O30 
2.68 3.0 3.3 3.4 3.6 3.7 3.8 3.9 4.0 4.1 4.2 


60 167an le Sh eee Dome 2.0406 2 liana (europe eee 20 | A 2n50 20d. ee eoO 
1.96 2.2 2.3 2.4 2.4 2.6 2.6 2.6 2.6 2.7 Cal 


ccd 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 
TOO EEL 00 unl O0 eI O0 an lOO me LOO Le 00m ets 00m a1 00m el 005 S100 


ote Ue ee ee a nee ee ee eee 
* Values in the column k = 2 and in the rows df = 2 and © are exact. Elsewhere 

the third digit may be in error by a few units for /’y; and several units for F’,99. The third 

digit figures of values marked by an asterisk are the most uncertain. 

source: Reproduced from Table 31 of E. S. Pearson and H. O. Hartley, Biometrika Tables for Statisticians, 


Vol. 1, 2nd ed., 1958, published by the Syndics of the Cambridge University Press, London; used by per- 
mission of the authors and publishers. 
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APPENDIX I 


Significant Studentized Ranges for Duncan’s New Multiple-Range 
Test 


To use these tables, the df and the range of the pairs of groups being 
compared must be located in the particular subtable which lists the level 
of significance desired. Assume that you wish to find the critical value 
using a two-tailed test at the .05 level of significance. To do this, first 
locate the df and k values in subtable “b,” for alpha equal to .05. The 
point at which the df row and the k& column intersect represents the 
minimum critical value for significance at the .05 level. If, for example, 
the df were equal to 15, the range of the pair being compared equal to 6, 
and the computed critical value equal to 4.53, it would be concluded that 
the difference between the groups was significant—i.e., the critical value 
for df = 15 and k = 6 is 3.356; 4.53 is larger and, therefore, significant 
beyond the .05 level. 
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APPENDIX J 


Critical Values of Wilcoxon’s T Statistic for the Matched-Pairs 
Signed-Ranks Test 


To use this table, first locate the number of pairs of scores in the n’ 
column. The critical values for the several levels of significance are listed 
in the columns to the right. For example, if n’ were 20 and the computed 
value 25, it would be concluded that since 25 is less than 38, this value is 
significant beyond the .01 level of significance for a two-tailed test.- 


Level of significance for one-tailed test 


.025 .O1 .005 
n' 
Level of significance for two-tailed test 

05 .02 01 
6 1 — -- 
7 2 0 — 
8 + 2 0 
9 6 3 2 
10 8 5 3 
11 11 7 5 
12 14 10 i, 
13 17 13 10 
14 21 16 13 
15 25 20 16 
16 30 24 19 
17 35 28 23 
18 40 33 28 
19 46 38 32 
20 52 43 37 
21 59 49 43 
22 66 56 49 
23 73 62 55 
24 81 69 61 
25 90 77 68 


Note that n’ is the number of matched pairs. 


source: Adapted from Table I of F. Wilcoxon, Some Rapid Approximate Statistical Procedures, rev. ed. 
New York: American Cyanamid Company, 1964. Reproduced from S. Siegel, Nonparametric Statistics for 
the Behavioral Sciences. New York: McGraw-Hill Book Company, 1956. Reprinted by permission of the 
American Cyanamid Company and McGraw-Hill Book Company. 
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APPENDIX K 
Coefficients for Orthogonal Polynomials 


In this table, the column headed by k indicates the number of com- 
ponents being compared. The columns headed by the ten X values indi- 
cate the actual coefficients to be used. Thus, if k = 3 groups were being 
analyzed, the coefficients for analysis of the linear component would be 
—1 for Group 1, 0 for Group 2, and 1 for Group 3. The quadratic coeffi- 
cients would be 1, —2, and 1 for the three respective groups. 


If Polynomial | X = 1 2 3 - 3 6 7 8 9 10 


3 | Linear —1 0 1 
Quadratic 1 -2 1 

4 | Linear —3 -—-1 1 
Quadratic 1 -1 -1 1 
Cubic —1 3. -3 1 

5 | Linear —2 -l 0 1 2 
Quadratic 2 -1 -2 -1 2 
Cubic —1 2 QO -—-2 1 
Quartic 1 —4 6 —4 1 

6 | Linear —-5 -3 —-Il 1 3 5 
Quadratic 5 -1 -4 -4 -Il 5 
Cubic —5 a 4 -4 -—-7 5 
Quartic 1 —-3 2 2 -3 1 

7 +| Linear —-3 —-2 -1 0 1 2, 3 
Quadratic 5 0 -3 -4 -8 0 5 
Cubic —1 1 1 0 —1 —l 1 
Quartic 3. -7 1 6 1 —-—7 3 

8 | Linear —7 -5 -8 —1 1 3 5 7 
Quadratic ii 1 —-3 -5 -5 -—-—83 Hh 7 
Cubic —7 5 7 3 .-3 —7 -—-5 7 
Quartic 7%, —13)) =3 9 9 -38 -13 u 
Quintic —7 23 —-17 —15 15 17 —23 7 

9 | Linear —-4 -3 -—-2 -1 0 1 2 3 4 
Quadratic 28 7 —8 -17 -20 -17 -8 Uf 28 
Cubic —14 7 13 9 0 -9 -13 —-7 14 
Quartic 14 -21 —ll1 9 18 9 -ll —21 14 
Quintic —4 11 —4 —9 0 9 4 —-ll 4 

10 | Linear —-9 -—-7 -5 -3 -Il 1 3 5 me 

Quadratic 6 2 -1 —-3 -4 -4 -3 -l 2 6 
Cubic —A42 14 35 31 12 -—12 -—31 -—35 —14 42 
Quartic 18 —22 —17 3 18 18 3 -17 —22 18 
Quintic —6 14 —1 -—-ll —6 6 11 1 -14 6 


Se eee ——e——E—E—EEeE—E—E——eeeeee 
sourcE: Abridged from Table B.10 of Statistical Principles in Experimental Design by B. J. Winer, Copy- 
right 1962 by McGraw-Hill Book Company. Used by permission of McGraw-Hill Book Company. 
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APPENDIX L 
Squares and Square Roots 


This table lists values of m = 1.00 to 10.00 in the first column, the 
squares of 7 in the second column, and the square roots of n in the third 
column. The fourth column gives the square roots of 10n, or the square 
roots of values from 10 (10 X 1.00) to 100 (10 X 10.00). The table can 
also be used to find the squares and square roots of values that have the 
same sequence of digits as n. In each of these operations, the decimal 
points in the values of n, n?, and ~/n must be adjusted accordingly. 


Appendix L. Squares and Square Roots 


bt et et pet et ee ee Pmt pel et pk et eg ee ee ne ——— oa — et et | ll aoeell cee el aed Somek ned femeh: prmah. fre 
Oe Te. SO OE OE See Oa. Cee CA Ca, Se ie eed AS Ree Cae oe SOC A. Re Oe Se oS ka ok ow 


Fah kk et pe 


n n? Vn Tn 

00 1.0000 1.00000 3.16228 
Ol 1.0201 1.00499 3.17805 
02 1.0404 1.00995 3.19374 
03 1.0609 1.01489 3.20936 
04 1.0816 1.01980 3.22490 
05 1.1025 1.02470 3.24037 
06 1.1236 1.02956 3.25576 
07 1.1449 1.03441 3.27109 
08 1.1664 1.03923 3.28634 
09 1.1881 1.04403 3.30151 
10 1.2100 1.04881 3.31662 
11 1.2321 1.05357 = 3..33167 
12 1.2544 1.058380 3.34664 
13 1.2769 1.06301 3.36155 
14 1.2996 1.06771 3.37639 
15 1.3225 1.07238 3.39116 
16 1.3456 1.07703 3.40588 
ies 1.3689 1.08167 3.42053 
18 1.3924 1.08628 3.438511 
19 1.4161 1.09087 3.44964 
20 1.4400 1.09545 3.46410 
21 1.4641 1.10000 3.47851 
22 1.4884 1.10454 3.49285 
23 1.5129 1.10905 3.50714 
24 1.5376 1.113855 3.52136 
25 125625, 1.11803 — 3.53553 
26 1.5876 1.12250 3.54965 
27 1.6129 1.12694 3.56371 
28 i6384, 513137 | Sou 
29 1.6641 1.13578 3.59166 
30 1.6900 1.14018 3.60555 
31 1.7161 1.14455 3.61939 
32 1.7424 1.14891 3.63318 
33 1.7689 1.15326 3.64692 
34 1.7956 1.15758 3.66060 
35 1.8225 1.16190 3.67423 
36 1.8496 1.16619 3.68782 
37 1.8769 1.17047 3.70135 
38 1.9044 1.17473 3.71484 
39 1.9321 1.17898 3.72827 
40 1.9600 1.183822 3.74166 
4l 1.9881 1.18743 3.75500 
42 2.0164 1.19164 3.76829 
43 2.0449 1.19583 3.78153 
44 2.07386 1.20000 3.79473 
45 2.1025 1.20416 3.80789 
46 2.1316 1.208380 3.82099 
47 2.1609 1.21244 3.83406 
48 2.1904 1.21655 3.84708 
49 2.2201 1.22066 3.86005 
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Ree eR Re fet pele ft eK pe ifekpe fede ft pet pe eee ee peat pet fae fel fod eS SS Sea 


ee pet ee 


n n® Vn V10n 

50 2.2500 1.22474 3.87298 
51 2.2801 1.22882 3.88587 
52 2.3104 1.23288 3.89872 
53 2.3409 1.23693 3.91152 
54 2.3716 1.24097 3.92428 
55 2.4025 1.24499 3.93700 
56 2.4336 1.24900 3.94968 
57 2.4649 1.25300 3.96232 
58 2.4964 1.25698 3.97492 
59 2.5281 1.26095 3.98748 
60 2.5600 1.26491 4.00000 
61 2.5921 1.26886 4.01248 
62 2.6244 1.27279 4.02492 
63 2.6569 1.27671 4.03733 
64 2.6896 1.28062 4.04969 
65 2.7225 1.28452 4.06202 
66 2.7556 1.28841 4.07431 
67 2.7889 1.29228 4.08656 
68 2.8224 1.29615 4.09878 
69 2.8561 1.30000 4.11096 
70 2.8900 1.30384 4.12311 
71 2.9241 1.30767 4.13521 
72 2.9584 1.31149 4.14729 
73 2.9929 1.31529 4.15933 
74 3.0276 1.31909 4.17133 
75 3.0625 1.32288 4.18330 
76 3.0976 1.32665 4.19524 
77 3.1329 1.33041 4.20714 
78 3.1684 1.33417 4.21900 
79 3.2041 1.33791 4.23084 
80 3.2400 1.34164 4.24264 
81 3.2761 1.345386 4.25441 
82 3.3124 1.34907 4.26615 
83 3.3489 1.35277 4.27785 
84 3.3856 1.35647 4.28952 
85 3.4225 1.36015 4.30116 
86 3.4596 1.36382 4.31277 
87 3.4969 1.386748 4.32435 
88 3.5344 1.37113 4.33590 
89 3.5721 1.37477 4.34741 
90 3.6100 1.37840 4.35890 
91 3.6481 1.38203 4.37035 
92 3.6864 1.38564 4.38178 
93 3.7249 1.38924 4.39318 
94 3.7636 1.39284 4.40454 
95 3.8025 1.39642 4.41588 
96 3.8416 1.40000 4.42719 
97 3.8809 1.40357 4.43847 
98 3.9204 1.40712 4.44972 
oo 3.9601 1.41067 4.46094 
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Appendix L. Squares and Square Roots (cont.) 


DAA Crorereord 


Oe i ll Oe 


fee med fame fom feed 


Vn V10n n n* Vn V10n 

41421 4.47214 pest, 6.2500 1.58114 5.00000 
.41774 4.48330 Zoo 6.3001 1.584380 5.00999 
.42127 4.49444 2.02 6.3504 1.58745 5.01996 
.42478 4.50555 2 53 6.4009 1.59060 5.02991 
-42829 4.51664 2.54 6.4516 1.59374 5.03984 
48178 4.52769 Zao 6.5025 1.59687 5.04975 
.48527 4.53872 2.56 6.5536 1.60000 5.05964 
48875 4.54973 PAT 6.6049 1.60312 5.06952 
.44222 4.56070 2.58 6.6564 1.60624 5.07937 
-44568 4.57165 2.59 6.7081 1.60935 5.08920 
44914 4.58258 2.60 6.7600 1.61245 5.09902 
.45258 4.59347 2.61 6.8121 1.61555 5.10882 
-45602 4.60435 2.62 6.8644 1.61864 5.11859 
-45945 4.61519 a0 6.9169 1.G2A73"> SAZ835 
.46287 4.62601 2.64 6.9696 1.62481 5.13809 
-46629 4.63681 2.65 7.0225. (1.62788 5.14782 
-46969 4.64758 2.66 7.0756 1.68095 5.15752 
-47309 4.65833 2.67 7.1289 1.63401 5.16720 
-47648 4.66905 2.68 7.1824 1.63707 5.17687 
-47986 4.67974 2.69 7.2361 1.64012 5.18652 
.48324 4.69042 200 7.2900 1.64317 5.19615 
-48661 4.70106 Dekel 7.3441 1.64621 5.20577 
-48997 4.71169 pa 4 7.38984 1.64924 5.21536 
.49332 4.72229 2.73 7.4529 1.65227 5.22494 
-49666 4.73286 2.74 7.5076 1.65529 5.23450 
.50000 4.74342 WG i020, —1.6583i 5.24404 
00833 4.75395 y pa § «| 7.0170, 1.66132 7 5.25357, 
.50665 4.76445 PANE Hf 7.6729 1.664383 5.26308 
.50997 4.77493 2.78 ties 21 66r50 | De2acon 
.513827 3=4.78539 2.79 7.7841 1.670383 5.28205 
.51658 4.79583 2.80 7.8400 1.67332 5.29150 
-51987 4.80625 2.81 7.8961 1.67631 5.30094 
.52315 4.81664 2.82 7.9524 1.67929 5.31037 
.52643 4.82701 2.83 8.0089 1.68226 5.31977 
.52971 4.83735 2.84 8.0656 1.68523" 5.232917 
.53297 4.84768 Ze 8.1225 1.68819 5.33854 
.58623 4.85798 2.86 8.1796 1.69115 5.34790 
538948 4.86826 Ae SH 8.2369 1.69411 5.35724 
.54272 4.87852 2.88 8.2944 1.69706 5.36656 
.04596 4.88876 2.89 S. 0021 1.70000 5.37587 
.54919 4.89898 2.90 8.4100 1.70294 5.38516 
55242 4.90918 2.91 8.4681 1.70587 5.39444 
55563 4.91935 2.92 8.5264 1.70880 5.40370 
.55885 4.92950 22938 8.5849 eC = 541205 
-56205 4.93964 2.94 8.6436 1.71464 5.42218 
56525 4.94975 2.95 8.7025 1.71756 5.43139 
.56844 4.95984 2.96 8.7616 1.72047 5.44059 
.57162 4.96991 2.97 8.8209 1.72337 5.44977 
.57480 4.97996 2.98 8.8804 1.72627 5.45894 
.57797 4.98999 2.99 8.9401 1.72916 5.46809 
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Appendix L. Squares and Square Roots (cont.) 


n n? Vn 10n n n? Vn Vion 
3.00 9.0000 1.73205 5.47723 3.50 12.2500 1.87083 5.91608 
3.01 9.0601 1.73494 5.48635 3.01 12.3201 1.87350 5.92453 
3.02 9.1204 1.73781 5.49545 3.52 12.3904 1.87617 5.93296 
3.03 9.1809 1.74069 5.50454 3.53 12.4609 1.87883 5.94138 
3.04 9.2416 1.74856 5.51362 3.54 12.5316 1.88149 5.94979 
3.05 9.38025 1.74642 5.52268 3.55 12.6025 1.88414 5.95819 
3.06 9.3686 1.74929 5.53173 3.56 12.6736 1.88680 5.96657 
3.07 9.4249 1.75214 5.54076 SrOt 12.7449 1.88944 5.97495 
3.08 9.4864 1.75499 5.54977 3.58 12.8164 1.89209 5.98331 
3.09 9.5481 1.75784 5.55878 3.59 12.8881 1.89473 5.99166 
3.10 9.6100 1.76068 5.56776 3.60 12.9600 1.89737 6.00000 
3.11 9.6721 1.76352 5.57674 3.61 13.0321 1.90000 6.00833 
3.12 9.7344 1.76635 5.58570 3.62 13.1044 1.90263 6.01664 
3.13 9.7969 1.76918 5.59464 3.63 13.1769 1.90526 6.02495 
3.14 9.8596 1.77200 5.60357 3.64 13.2496 1.90788 6.03324 
3.15 9.9225 1.77482 5.61249 3.65 13.8225 1.91050 6.04152 
3.16 9.9856 1.77764 5.62139 3.66 13.3956 1.91311 6.04979 
ond 10.0489 1.78045 5.63028 3.67 13.4689 1.91572 6.05805 
3.18 10.1124 1.78326 5.63915 3.68 13.5424 1.918383 6.06630 
3.19 10.1761 1.78606 5.64801 3.69 13.6161 1.92094 6.07454 
3.20 10.2400 1.78885 5.65685 oncO 13.6900 1.92354 6.08276 
3.21 10.3041 1.79165 5.66569 BRA! 13.7641 1.92614 6.09098 
See 10.3684 1.79444 5.67450 3.72 13.8384 1.92873 6.09918 
3.23 10.4829 1.79722 5.68331 3.%3 139129) S17, 93132. 9 16.10737 
3.24 10.4976 1.80000 5.69210 3.74 13.9876 1.93391 6.11555 
3.25 10.5625 1.80278 5.70088 3.75 14.0625 1.93649 6.12372 
3.26 10.6276 1.80555 5.70964 3.76 14.1376 1.938907 6.13188 
Sent 10.6929 1.80831 5.71839 3.40 14.2129 1.94165 6.14003 
3.28 10.7584 1.81108 5.72713 3.78 14.2884 1.94422 6.14817 
3.29 10.8241 1.81384 5.73585 3.79 14.3641 1.94679 6.15630 
3.30 10.8900 1.81659 5.74456 3.80 14.4400 1.949386 6.16441 
3.31 10.9561 1.819384 5.75326 3.81 14.5161 1.95192 6.17252 
3.32 11.0224 1.82209 5.76194 3.82 14.5924 1.95448 6.18061 
3.33 11.0889 1.82483 5.77062 3.83 14.6689 1.95704 6.18870 
3.34 TUN SbES 91282757 25577927, 3.84 14.7456 1.95959 6.19677 
3.35 11.2225 1.83030 5.78792 3.85 14.8225 1.96214 6.20484 
3.36 11.2896 1.83303 5.79655 3.86 14.8996 1.96469 6.21289 
3.37 11.3569. 1.83576 5.80517 3.87 14.9769 1.96723 6.22093 
3.38 11.4244 1.838848 5.81378 3.88 15.0544 1.96977 6.22896 
3.39 11.4921 1.84120 5.82237 3.89 15-1321 1.97231 6.23699 
3.40 11.5600 1.84891 5.838095 3.90 15.2100 1.97484 6.24500 
3.41 11.6281 1.84662 5.83952 3.91 15.2881 1.97737 6.25300 
3.42 11.6964 1.849382 5.84808 3.92 15.3664 1.97990 6.26099 
3.43 11.7649 1.85203 5.85662 3.93 15.4449 1.98242 6.26897 
3.44 11.8336 1.85472 5.86515 3.94 15.5236 1.98494 6.27694 
3.45 11.9025. 1.85742 5.87367 3.95 15.6025 1.98746 6.28490 
3.46 11.9716 1.86011 5.88218 3.96 15.6816 1.98997 6.29285 
3.40 12.0409 1.86279 5.89067 3.97 15.7609 1.99249 6.30079 
3.48 12.1104 1.86548 5.89915 3.98 15.8408 1.99499 6.30872 
3.49 12.1801 1.86815 5.90762 3.99 15.9201 1.99750 6.31664 
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Appendix L. Squares and Square Roots (cont.) 


n n? Vn /10n n i Vn 10n 
4.00 | 16.0000 2.00000 6.32456 4.50 | 20.2500 2.12132 6.70820 
4.01 | 16.0801 2.00250 6.33246 4.51 | 20.3401 2.12368 6.71565 
4.02 | 16.1604 2.00499 6.34035 4.52 | 20.4304 2.12603 6.72309 
4.03 | 16.2409 2.00749 6.34823 4.53 | 20.5209 2.12838 6.73053 
4.04 | 16.3216 2.00998 6.35610 4.54 | 20.6116 2.13073 6.73795 
4.05 | 16.4025 2.01246 6.36396 4.55 | 20.7025 2.13307 6.74537 
4.06 | 16.4836 2.01494 6.37181 4.56 | 20.7936 2.13542 6.75278 
4.07 | 16.5649 2.01742 6.37966 4.57 | 20.8849 2.13776 6.76018 
4.08 | 16.6464 2.01990 6.38749 4.58 | 20.9764 2.14009 6.76757 
4.09 | 16.7281 2.02237 6.39531 4.59 | 21.0681 2.14243 6.77495 
4.10 | 16.8100 2.02485 6.40312 4.60 | 21.1600 2.14476 6.78233 
4.11 | 16.8921 2.02731 6.41093 4.61 | 21.2521 2.14709 6.78970 
4.12 | 16.9744 2.02978 6.41872 4.62 | 21.3444 2.14942 6.79706 
4.13 | 17.0569 2.03224 6.42651 4.63 | 21.4369 2.15174 6.80441 
4.14| 17.1396 2.03470 6.43428 4.64 | 21.5296 2.15407 6.81175 
4.15 | 17.2225 2.03715 6.44205 4.65 | 21.6225 2.15639 6.81909 
4.16 | 17.3056 2.03961 6.44981 4.66 | 21.7156 2.15870 6.82642 
4.17 | 17.3889 2.04206 6.45755 4.67 | 21.8089 2.16102 6.83374 
4.18 | 17.4724 2.04450 6.46529 4.68 | 21.9024 2.16333 6.84105 
4.19 | 17.5561 2.04695 6.47302 4.69 | 21.9961 2.16564 6.84836 
4.20 | 17.6400 2.04939 6.48074 4.70 | 22.0900 2.16795 6.85565 
4.21 | 17.7241 2.05183 6.48845 4.71 | 22.1841 2.17025 6.86294 
4.22 |} 17.8084 2.05426 6.49615 4.72 | 22.2784 2.17256 6.87023 
4.23 | 17.8929 2.05670 6.50384 4.73 | 22.3729 2.17486 6.87750 
4.24 | 17.9776 2.059138 6.51153 4.74 | 22.4676 2.17715 6.88477 
4.25 | 18.0625 2.06155 6.51920 4.75 | 22.5625 2.17945 6.89202 
4,26 | 18.1476 2.06398 6.52687 4.76 | 22.6576 2.18174 6.89928 
4.27 | "18.2329 2.06640 6.53452 4.77 | 22.7529 2.18403 6.90652 
4.28 | 18.3184 2.06882 6.54217 4.78 | 22.8484 2.18632 6.91375 
4.29 | 18.4041 2.07123 6.54981 4.79 | 22.9441 2.18861 6.92098 
4.30 | 18.4900 2.07364 6.55744 4.80 | 23.0400 2.19089 6.92820 
4.31 | 18.5761 2.07605 6.56506 4.81 | 23.1361 2.19317 6.93542 
4.32 | 18.6624 2.07846 6.57267 4.82 | 23.2324 2.19545 6.94262 
4.33 | 18.7489 2.08087 6.58027 4.83 | 23.3289 2.19773 6.94982 
4.34 | 18.8356 2.08327 6.58787 4.84 | 23.4256 2.20000 6.95701 
4.35 | 18.9225 2.08567 6.59545 4.85 | 23.5225 2.20227 6.96419 
4.36 | 19.0096 2.08806 6.60303 4.86 | 23.6196 2.20454 6.97137 
4.37 | 19.0969 2.09045 6.61060 4.87 | 23.7169 2.20681 6.97854 
4.38 | 19.1844 2.09284 6.61816 4.88 | 23.8144 2.20907 6.98570 
4.39 | 19.2721 2.09523 6.62571 4.89 | 23.9121 2.21133 6.99285 
4.40 | 19.3600 2.09762 6.63325 4.90 | 24.0100 2.21359 7.00000 
4.41 | 19.4481 2.10000 6.64078 4.91 | 24.1081 2.21585 7.00714 
4.42 | 19.5364 2.10238 6.64831 4.92 | 24.2064 2.21811 7.01427 
4.43 | 19.6249 2.10476 6.65582 4.93 | 24.3049 2.22036 7.02140 
4.44} 19.7136 2.10713 6.66333 4.94 | 24.4036 2.22261 7.02851 
4.45 | 19.8025 2.10950 6.67083 4.95 | 24.5025 2.22486 7.03562 
4.46 | 19.8916 2.11187 6.67832 4.96 | 24.6016 2.22711 7.04273 
4.47 | 19.9809 2.11424 6.68581 4.97 | 24.7009 2.229385 7.04982 
4.48 | 20.0704 2.11660 6.69328 4.98 | 24.8004 2.23159 7.05691 
4.49 | 20.1601 2.11896 6.70075 4.99 | 24.9001 2.23383 7.06399 
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Appendix L. Squares and Square Roots (cont.) 


” n* Vn V10n n n? ie “/ 107 
5.00 25.0000 2.23607 7.07107 5.50 30.2500 2.34521 7.41620 
5.01 25.1001 2.23830 7.07814 5.51 30.3601 2.34734 7.42294 
5.02 25.2004 2.24054 7.08520 5.52 30.4704 2.34947 7.42967 
5.03 25.3009 2.24277 7.09225 5.53 30.5809 2.35160 7.43640 
5.04 25.4016 2.24499 7.09930 5.54 30.6916 2.35372 7.44312 
5.05 25.5025 2.24722 7.10634 5.55 30.8025 2.35584 7.44983 
5.06 25.6036 2.24944 7.11337 5.56 30.9136 2.35797 7.45654 
5.07 25.7049 2.25167 7.12039 5.57 31.0249 2.36008 7.46324 
5.08 25.8064 2.25389 7.12741 5.58 31.1364 2.36220 7.46994 
5.09 25.9081 2.25610 7.13442 5.59 31.2481 2.36432 7.47663 
5.10 26.0100 2.25832 7.14143 5.60 31.3600 2.36643 7.48331 
5.11 26.1121 2.26053 7.14843 5.61 31.4721 2.36854 7.48999 
5.12 26.2144 2.26274 7.15542 5.62 31.5844 2.37065 7.49667 
5.13 26.3169 2.26495 7.16240 5.63 31.6969 2.37276 7.50333 
5.14 26.4196 2.26716 7.16938 5.64 31.8096 2.37487 7.50999 
5.15 26.5225 2.269386 7.17635 5.65 31.9225 2.37697 7.51665 
5.16 26.6256 2.27156 7.18331 5.66 32.0356 2.37908 7.52330 
5.17 26.7289 2.27376 7.19027 5.67 32.1489 2.38118 7.52994 
5.18 26.8324 2.27596 7.19722 5.68 32.2624 2.38328 7.53658 
5.19 26.9361 2.27816 7.20417 5.69 32.3761 2.38537 7.54321 
5.20 27.0400 2.28035 7.21110 5.70 32.4900 2.38747 7.54983 
5.21 27.1441 2.28254 7.21803 §.71 32.6041 2.38956 7.55645 
5.22 27.2484 2.28473 7.22496 5.72 32.7184 2.39165 7.56307 
5.23 27.3529 2.28692 7.23187 5.73 32.8329 2.39374 7.56968 
5.24 27.4576 2.28910 7.23878 5.74 32.9476 2.39583 7.57628 
5.25 27.5625 2.29129 7.24569 5.75 33.0625 2.39792 7.58288 
5.26 27.6676 2.293847 7.25259 5.76 33.1776 2.40000 7.58947 
5.27 27.7729 =6.2..29565 = 7.25948 5.77 33.2929 2.40208 7.59605 
5.28 27.8784 2.29783 7.26636 5.78 33.4084 2.40416 7.60263 
5.29 27.9841 2.30000 7.27324 5.79 33.5241 2.40624 7.60920 
5.30 28.0900 2.30217 7.28011 5.80 33.6400 2.40832 7.61577 
5.31 28.1961 2.30434 7.28697 5.81 33.7561 2.41039 7.62234 
5.32 28.3024 2.30651 7.29383 5.82 33.8724 2.41247 7.62889 
5.33 28.4089 2.30868 7.30068 5.83 33.9889 2.41454 7.63544 
5.34 28.5156 2.31084 7.30753 5.84 34.1056 2.41661 7.64199 
5.35 28.6225 2.31301 7.31437 5.85 34.2225 2.41868 7.64853 
5.36 28.7296 2.31517 7.32120 5.86 34.3396 2.42074 7.65506 
5.37 28.8369 2.31733 7.32803 5.87 34.4569 2.42281 7.66159 
5.38 28.9444 2.31948 7.33485 5.88 34.5744 2.42487 7.66812 
5.39 29.0521 2.32164 7.34166 5.89 34.6921 2.42693 7.67463 
5.40 29.1600 2.32379 7.34847 5.90 34.8100 2.42899 7.68115 
5.41 29.2681 2.32594 7.35527 5.91 34.9281 2.43105 7.68765 
5.42 29.3764 2.32809 7.36206 5.92 35.0464 2.438311 7.69415 
5.43 29.4849 2.33024 7.36885 5.93 35.1649 2.43516 7.70065 
5.44 29.5936 2.33238 7.37564 5.94 35.2836 2.43721 7.70714 
5.45 29.7025 2.33452 7.38241 5.95 85.4025 2.43926 7.71362 
5.46 29.8116 2.33666 7.38918 5.96 35.5216 2.44131 7.72010 
5.47 29.9209 2.33880 7.39594 5.97 35.6409 2.44336 7.72658 
5.48 30.0304 2.34094 7.40270 5.98 | 35.7604 2.44540 7.73305 
5.49 30.1401 2.34807 7.40945 5.99 35.8801 2.44745 7.73951 
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Appendix L. Squares and Square Roots (cont.) 


n n? Vn V10n n | n? Vn V10n 
| 
6.00 36.0000 2.44949 7.74597 6.50 | 42.2500 2.54951 8.06226 
6.01 36.1201 2.45153 — 7.75242 6.51 42.3801 2.55147 8.06846 
6.02 36.2404 2.453857 7.75887 6.52 | 42.5104 2.55343 8.07465 
6.03 | 36.3609 2.45561 7.76531 6.53 | 42.6409 2.55539 8.08084 
6.04 | 36.4816 2.45764 7.77174 6.54 | 42.7716 2.55734 8.08703 
6.05 36.6025 2.45967 7.77817 6.55 | 42.9025 2.55930 8.09321 
6.06 36.7236 2.46171 7.78460 6.56 | 43.0336 2.56125 8.09938 
6.07 | 36.8449 2.46374 7.79102 6.57 | 43.1649 2.56320 8.10555 
6.08 | 36.9664 2.46577 7.79744 6.58 | 43.2964 2.56515 8.11172 
6.09 37.0881 2.46779 7.80385 6.59 43.4281 2.56710 8.11788 
6.10 | 37.2100 2.46982 7.81025 6.60 | 43.5600 2.56905 8.12404 
6.11 37.3321 2.47184 7.81665 6.61 | 43.6921 2.57099 8.13019 
6.12 37.4544 2.47386 7.82304 6.62 43.8244 2.57294 8.138634 
6.13 | 37.5769 2.47588 7.82943 6.63 | 43.9569 2.57488 8.14248 
6.14 | 37.6996 2.47790 7.83582 6.64 | 44.0896 2.57682 8.14862 
6.15 | 37.8225 2.47992 7.84219 6.65 | 44.2225 2.57876 8.15475 
6.16 | 37.9456 2.48193 7.84857 6.66 | 44.3556 2.58070 8.16088 
6.17 | 38.0689 2.48395 7.85493 6.67 | 44.4889 2.58263 8.16701 
6.18 08.1924 2.48596 7.86130 6.68 44.6224 2.58457 8.17313 
6.19 | 38.3161 2.48797 7.86766 6.69 | 44.7561 2.58650 8.17924 
| 
6.20 | 38.4400 2.48998 7.87401 6.70 | 44.8900 2.58844 8.18535 
6.21 | 38.5641 2.49199 7.88036 6.71 | 45.0241 2.59037 8.19146 
6.22 | 38.6884 2.49399 7.88670 6.72 | 45.1584 2.59230 8.19756 
6.23 38.8129 2.49600 7.89303 6.73 | 45.2929 2.59422 8.20366 
6.24 | 38.9376 2.49800 7.89937 6.74 | 45.4276 2.59615 8.20975 
6.25 39.0625 2.50000 7.90569 6.75 | 45.5625 2.59808 8.21584 
6.26 | 39.1876 2.50200 7.91202 6.76 45.6976 2.60000 8.22192 
6.27 39.3129 2.50400 7.91833 6.77 45.8329 2.60192 8.22800 
6.28 39.4384 2.50599 7.92465 6.78 45.9684 2.60384 8.23408 
6.29 39.5641 2.50799 7.93095 6.79 46.1041 2.60576 8.24015 
6.30 39.6900 2.50998 7.93725 6.80 46.2400 2.60768 8.24621 
6.31 39.8161 2.51197 7.94355 6.81 46.3761 2.60960 8.25227 
6.32 39.9424 2.513896 7.94984 6.82 | 46.5124 2.61151 8.25833 
6.33 40.0689 2.51595 7.95613 6.83 | 46.6489 2.61343 8.26438 
6.34 | 40.1956 2.51794 7.96241 6.84 |. 46.7856 2.61534 8.27043 
6.35 | 40.3225 2.51992 7.96869 6.85 | 46.9225 2.61725 8.27647 
6.36 40.4496 2.52190 7.97496 6.86 | 47.0596 2.61916 8.28251 
6.37 40.5769 2.52389 7.98123 6.87 47.1969 2.62107 8.28855 
6.38 40.7044 2.52587 7.98749 6.88 47.3344 2.62298 8.29458 
6.39 | 40.8321 2.52784 7.99875 6.89 | 47.4721 2.62488 8.30060 
6.40 | 40.9600 2.52982 8.00000 6.90 | 47.6100 2.62679 8.30662 
6.41 41.0881 2.53180 8.00625 6.91 47.7481 2.62869 8.31264 
6.42 41.2164 2.53377 8.01249 6.92 47.8864 2.63059 8.31865 
6.43 | 41.3449 2.58574 8.01873 6.93 | 48.0249 2.63249 8.32466 
6.44 | 41.4736 2.53772 8.02496 6.94 | 48.1686 2.63439 8.33067 
6.45 | 41.6025 2.53969 8.03119 6.95 | 48.3025 2.63629 8.33667 
6.46 | 41.7316 2.54165 8.03741 6.96 | 48.4416 2.63818 8.34266 
6.47 | 41.8609 2.54362 8.04363 6.97 | 48.5809 2.64008 8.34865 
6.48 | 41.9904 2.54558 8.04984 6.98 | 48.7204 2.64197 8.35464 
6.49 | 42.1201 2.54755 8.05605 6.99 | 48.8601 2.64386 8.36062 
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Appendix L. Squares and Square Roots (cont.) 


n n? Vn V10n n n? xi ti J10n 
7.00 49.0000 2.64575 8.36660 7.50 56.2500 2.73861 8.66025 
7.01 49.1401 2.64764 8.37257 WoL 56.4001 2.74044 8.66603 
7.02 49.2804 2.64953 8.37854 7.52 56.5504 2.74226 8.67179 
7.03 49.4209 2.65141 8.38451 7.53 56.7009 2.74408 8.67756 
7.04 49.5616 2.65330 8.39047 7.54 56.8516 2.74591 8.68332 
1205 49.7025 2.65518 8.39643 (eas) 57.0025 2.74773 8.68907 
7.06 49.8436 2.65707 8.40238 7.56 57.1536 2.74955 8.69483 
4A0G 49.9849 2.65895 8.40833 7.57 57.3049 2.75136 8.70057 
7.08 50.1264 2.66083 8.41427 7.58 57.4564 2.75318 8.70632 
7.09 50.2681 2.66271 8.42021 7.59 57.6081 2.75500 8.71206 
7.10 50.4100 2.66458 8.42615 7.60 57.7600 2.75681 8.71780 
Vie al 50.5521 2.66646 8.438208 7.61 DIU 20802) eS 2000 
7.12 50.6944 2.66833 8.43801 7.62 58.0644 2.76043 8.72926 
7.13 50.8369 2.67021 8.44393 7.63 58.2169 2.76225 8.73499 
7.14 50.9796 2.67208 8.44985 7.64 58.3696 2.76405 8.74071 
7.15 51.1225 2.67395 8.45577 7.65 58.5225 2.76586 8.74643 
2G 51.2656 2.67582 8.46168 7.66 58.6756 2.76767 8.75214 
CNG 51.4089 2.67769 8.46759 7.67 58.8289 2.76948 8.75785 
(pike: 51.5524 2.67955 8.47349 7.68 58.9824 2.77128 8.76356 
7.19 51.6961 2.68142 8.47939 7.69 59.1361 2.77308 8.76926 
7.20 51.8400 2.68328 8.48528 7.70 59.2900 2.77489 8.77496 
7.21 51.9841 2.68514 8.49117 Ca 59.4441 2.77669 8.78066 
7.22 52.1284 2.68701 8.49706 Tae 59.5984 2.77849 8.78635 
7.23 52.2729 2.68887 8.50294 7.73 59.7529 2.78029 8.79204 
7.24 52.4176 2.69072 8.50882 7.74 59.9076 2.78209 8.79773 
7.25 52.5625 2.69258 8.51469 7.75 60.0625 2.78388 8.80341 
7.26 52.7076 2.69444 8.52056 Calo: 60.2176 2.78568 8.80909 
7.27 52.8529 2.69629 8.52643" ed, 60.3729 2.78747 8.81476 
7.28 52.9984 2.69815 8.53229 Toe 60.5284 2.78927 8.82043 
7.29 53.1441 2.70000 8.53815 7.79 60.6841 2.79106 8.82610 
7.30 53.2900 2.70185 8.54400 7.80 60.8400 2.79285 8.83176 
7.31 53.4361 2.70370 8.54985 7.81 60.9961 2.79464 8.83742 
7.32 53.5824 2.70555 8.55570 7.82 61.1524 2.79643 8.84308 
7.33 53.7289 2.70740 8.56154 7.83 61.3089 2.79821 8.84873 
7.34 53.8756 2.70924 8.56738 7.84 61.4656 2.80000 8.85438 
7.35 54.0225 2.71109 8.57321 7.85 61.6225 2.80179 8.86002 
7.36 54.1696 2.71293 8.57904 7.86 61.7796 2.80357 8.86566 
7.37 54.3169 2.71477 8.58487 7.87 61.9369 2.80535 8.87130 
7.38 54.4644 2.71662 8.59069 7.88 62.0944 2.80713 8.87694 
7.39 54.6121 2.71846 8.59651 7.89 62.2521 2.80891 8.88257 
7.40 54.7600 2.72029 8.60233 7.90 62.4100 2.81069 8.88819 
7.41 54.9081 2.72213 8.60814 7.91 62.5681 2.81247 8.89382 
7.42 55.0564 2.72397 8.61394 7.92 62.7264 2.81425 8.89944 
7.43 55.2049 2.72580 8.61974 7.93 62.8849 2.81603 8.90505 
7.44 55.3536 2.72764 8.62554 7.94 63.0436 2.81780 8.91067 
7.45 55.5025 2.72947 8.63134 7.95 63.2025 2.81957 8.91628 
7.46 55.6516 2.731380 8.63713 7.96 63.3616 2.82135 8.92188 
7.47 55.8009 2.73313 8.64292 le97 63.5209 2.82312 8.92749 
7.48 55.9504 2.73496 8.64870 7.98 63.6804 2.82489 8.93308 
7.49 56.1001 2.73679 8.65448 7.99 63.8401 2.82666 8.93868 
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Appendix L. Squares and Square Roots (cont.) 


(9) 
= 
i=) 


n? Vn V10n 
64.0000 2.82843 8.94427 
64.1601 2.83019 8.94986 
64.3204 2.83196 8.95545 
64.4809 2.83373 8.96103 
64.6416 2.83549 8.96660 
64.8025 2.83725 8.97218 
64.9636 2.83901 8.97775 
65.1249 2.84077 8.98332 
65.2864 2.84253 8.98888 
65.4481 2.84429 8.99444 
65.6100 2.84605 9.00000 
65.7721 2.84781 9.00555 
65.9344 2.84956 9.01110 
66.0969 2.85132 9.01665 
66.2596 2.85307 9.02219 
66.4225 2.85482 9.02774 
66.5856 2.85657 9.03327 
66.7489 2.85832 9.03881 
66.9124 2.86007 9.04434 
67.0761 2.86182 9.04986 
67.2400 2.86356 9.05539 
67.4041 2.86531 9.06091 
67.5684 2.86705 9.06642 
67.7329 2.86880 9.07193 
67.8976 2.87054 9.07744 
68.0625 2.87228 9.08295 
68.2276 2.87402 9.08845 
68.3929 2.87576 9.09395 
68.5584 2.87750 9.09945 
68.7241 2.87924 9.10494 
68.8900 2.88097 9.11043 
69.0561 2.88271 9.11592 
69.2224 2.88444 9.12140 
69.3889 2.88617 9.12688 
69.5556 2.88791 9.13236 
69.7225 2.88964 9.13783 
69.8896 2.89137 9.14330 
70.0569 2.89310 9.14877 
70.2244 2.89482 9.15423 
70.3921 2.89655 9.15969 
70.5600 2.89828 9.16515 
70.7281 2.90000 9.17061 
70.8964 2.90172 9.17606 
71.0649 2.90345 9.18150 
71.2386 2.90517 9.18695 
71.4025 2.90689 9.19239 
71.5716 2.90861 9.19783 
71.7409 2.91033 9.20326 
71.9104 2.91204 9.20869 
72.0801 2.91376 9.21412 


n n* Vn 
50 72.2500 2.91548 
ai! 72.4201 2.91719 
52 72.5904 2.91890 
53 72.7609 2.92062 
54 72.9316 2.92233 
55 73.1025 2.92404 
56 (a.tiao § 2.92010 
57 73.4449 2.92746 
58 73.6164 2.92916 
59 73.7881 2.93087 
60 73.9600 2.93258 
61 74.1321 2.93428 
62 74.3044 2.93598 
63 74.4769 2.93769 
64 74.6496 2.93939 
65 74.8225 2.94109 
66 74.9956 2.94279 
67 75.1689 2.94449 
68 75.3424 2.94618 
69 £50161 2.94788 
70 75.6900 2.94958 
71 75.8641 2.95127 
ee 76.0384 2.95296 
73 76.2129 2.95466 
76.3876 2.95635 
‘ee 76.5625 2.95804 
76 76.7376 2.95973 
ee 76.9129 2.96142 
78 77.0884 2.96311 
79 77.2641 2.96479 
80 77.4400 2.96648 
81 77.6161 2.96816 
82 77.7924 2.96985 
83 77.9689 2.97153 
84 78.1456 2.97321 
85 78.3225 2.97489 
86 78.4996 2.97658 
87 78.6769 2.97825 
88 78.8544 2.97993 
89 79.0321 2.98161 
90 79.2100 2.98329 
91 79.3881 2.98496 
92 79.5664 2.98664 
93 79.7449 2.98831 
94 79.9236 2.98998 
95 80.1025 2.99166 
96 80.2816 2.99333 
97 80.4609 2.99500 
98 80.6404 2.99666 
80.8201 2.99833 
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.30054 
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32738 
33274 
33809 
34345 
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35414 
35949 
36483 
37017 


.37550 


. 38083 
.38616 
.39149 
.39681 
.40213 


40744 
.41276 
.41807 
.42338 
-42868 


-43398 
-43928 
.44458 
-44987 
-45516 


. 46044 
-46573 
-47101 
.47629 
.48156 


Appendix L. Squares and Square Roots (cont.) 


Ne) 


S 
o 


n* vn V10n 
81.0000 3.00000 9.48683 
81.1801 3.00167 9.49210 
81.3604 3.00333 9.49737 
81.5409 3.00500 9.50263 
81.7216 3.00666 9.50789 
81.9025 3.00832 9.51315 
82.0836 3.00998 9.51840 
82.2649 3.01164 9.52365 
82.4464 3.01330 9.52890 
82.6281 3.01496 9.53415 
82.8100 3.01662 9.53939 
82.9921 3.01828 9.54463 
83.1744 3.01993 9.54987 
83.3569 3.02159 9.55510 
83.5396 3.02324 9.56033 
83.7225 3.02490 9.56556 
83.9056 3.02655 9.57079 
84.0889 3.02820 9.57601 
84.2724 3.02985 9.58123 
84.4561 3.03150 9.58645 
84.6400 3.03315 9.59166 
84.8241 3.03480 9.59687 
85.0084 3.03645 9.60208 
85.1929 3.03809 9.60729 
85.3776 3.03974 9.61249 
85.5625 3.04138 9.61769 
85.7476 3.04302 9.62289 
85.9329 3.04467 9.62808 
86.1184 3.04631 9.63328 
86.3041 3.04795 9.63846 
86.4900 3.04959 9.64365 
86.6761 3.05123 9.64883 
86.8624 3.05287 9.65401 
87.0489 3.05450 9.65919 
87.2356 3.05614 9.66437 
87.4225 3.05778 9.66954 
87.6096 3.05941 9.67471 
87.7969 3.06105 9.67988 
87.9844 3.06268 9.68504 
88.1721 3.06431 9.69020 
88.3600 3.06594 9.69536 
88.5481 3.06757 9.70052 
88.7364 3.06920 9.70567 
88.9249 3.07083 9.71082 
89.1136 3.07246 9.71597 
89.3025 3.07409 9.72111 
89.4916 3.07571 9.72625 
89.6809 3.07734 9.73139 
89.8704 3.07896 9.73653 
90.0601 3.08058 9.74166 
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n n? Vn 10n 
9.50 90.2500 3.08221 9.74679 
9.51 90.4401 3.08383 9.75192 
9.52 90.6304 3.08545 9.75705 
9.53 90.8209 3.08707 9.76217 
9.54 91.0116 3.08869 9.76729 
9.55 91.2025 3.09031 9.77241 
9.56 91.3936 3.09192 9.77753 
9.57 91.5849 3.09354 9.78264 
9.58 91.7764 3.09516 9.78775 
9.59 91.9681 3.09677 9.79285 
9.60 92.1600 3.09839 9.79796 
9.61 92.3521 3.10000 9.80306 
9.62 92.5444 3.10161 9.80816 
9.63 92.7369 3.10322 9.81326 
9.64 92.9296 3.10483 9.81835 
9.65 93.1225 3.10644 9.82344 
9.66 93.3156 3.10805 9.82853 
9.67 93.5089 3.10966 9.83362 
9.68 93.7024 3.11127 9.83870 
9.69 93.8961 3.11288 9.84378 
9.70 94.0900 3.11448 9.84886 
9.71 94.2841 3.11609 9.85393 
9.72 94.4784 3.11769 9.85901 
9.73 94.6729 3.11929 9.86408 
9.74 94.8676 3.12090 9.86914 
9.75 95.0625 3.12250 9.87421 
9.76 95.2576 3.12410 9.87927 
9.77 95.4529 3.12570 9.88433 
9.78 95.6484 3.12730 9.88939 
9.79 95.8441 3.12890 9.89444 
9.80 96.0400 3.13050 9.89949 
9.81 96.2361 3.13209 9.90454 
9.82 96.4324 3.13369 9.90959 
9.83 96.6289 3.13528 9.91464 
9.84 96.8256 3.13688 9.91968 
9.85 97.0225 3.13847 9.92472 
9.86 97.2196 3.14006 9.92975 
9.87 97.4169 3.14166 9.93479 
9.88 97.6144 3.14825 9.93982 
9.89 97.8121 3.14484 9.94485 
9.90 98.0100 3.14643 9.94987 
9.91 98.2081 3.14802 9.95490 
9.92 98.4064 3.14960 9.95992 
9.93 98.6049 3.15119 9.96494 
9.94 98.8036 3.15278 9.96995 
9.95 99.0025 3.15486 9.97497 
9.96 99.2016 3.15595 9.97998 
9.97 99.4009 3.15753 9.98499 
9.98 99.6004 3.15911 9.98999 
9.99 99.8001 3.16070 9.99500 

10.00 | 100.000 3.16228 10.0000 
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APPENDIX M 
Sample Computer Programs for Analysis of Variance 


The following two computer programs demonstrate how the step-by- 
step approach of this book can be applied to the use of FORTRAN IV for 
computer programing. These particular programs were written from the 
computational examples presented in Sections 2.9 and 2.10 and were 
verified on an IBM Model 360 computer. They should prove especially 
useful to the beginning programer and also to the experienced programer 
who is not familiar with analysis of variance. They not only demonstrate 
the basic computational steps which are part of all analyses of variance, 
but they also show the special steps that are needed when data must be 
retabled (Section 2.9) and where counterbalancing is required (Section 
2.10). While it is recognized that more efficient and elaborate programs 
could be written, the two that are presented here do demonstrate solu- 
tions to nearly every type of problem which might be encountered in the 
programing of such analyses of variance. 
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Appendix M. Program for Three-Factor Mixed Design: Repeated 


Measures on Two Factors (Section 2.9) 


c PROGRAM LANGUAGE = FORTRAN IV 

c PROGRAM WRITTEN FOR IBM 360 OS-E LEVEL 

c 

C MAXIMUM CAPABILITIES ARE- 

C UP TO 4 GROUPS 

C NUMBER OF GROUPS READ IN AS NGROUP ON PARAMETER CARD 

C UP TO 30 SS PER GROUP 

C NUMBER OF SS READ AS NN ON PARAMETER CARD 

C uP TO 5 LEVELS OF EXPERIMENTAL TREATMENT 1 

C NUMBER OF LEVELS OF TR. 1 IS READ AS KK ON PARAMETER CARD 

C UP TO 5 LEVELS OF EXPERIMENTAL TREATMENT 2 

C NUMBER OF LEVELS OF TR. 2 IS READ AS LL ON PARAMETER CARD 

C NUMBER OF LEVELS OF EACH TREATMENT MAY BE INCREASED IF NECESSARY BY CHANGING 
C DIMENSIONS 

c 

Cc 

c SUBROUTINES FMITM AND FMTC PERMIT CHANGING OF DATA READ IN FORMATS 

c 

c 

c 

C SUBMIT CARDS IN FOLLOWING ORDER 

Cc 

c PROGRAM CARDS 

Cc 

C OUTPUT IDENTIFICATION CARD — — — THIS CARD CONTAINS THE FOLLOWING PUNCHES —- 
C STARTING IN COL~ 1 TOTLBSUBGRPSERBTWINSTR 1TR 2GRX1GRX2LX2 GX23E1l E2 €E3 
C THIS CARD SETS UP THE FORM OF THE SUMMARY TABLE 

C THIS CARD MUST BE INCLUDED AS THE FIRST DATA CARD 

c 

c 

C THE NEXT CARD 1S YOUR IDENTIFICATION CARD. USE ANY OF THE 80 COLS. FOR 

C INFORMATION THAT YOU WISH TO APPEAR AS A HEADING TO YOUR OUTPUT. 

c 

C THE NEXT CARD IS THE PARAMETER CARD AND SHOULD BE PUNCHED IN THE 

C FOLLOWING MANNER —— 

C COL. 1-2 THE NUMBER OF SUBJECTS PER GROUP (UP TO 30) 

C COL. 4-5 THE NUMBER OF LEVELS OF TREATMENT 1 (UP TO 5) 

C COLe 7-8 THE NUMBER OF LEVELS OF TREATMENT 2 (UP TO 5) 

C COL. 10-11 LEAVE BLANK IF USING STANDARD FORMAT. PUNCH O1 IF USING FMTM AND 
C FMTIC SUBROUTINES TO CHANGE DATA INPUT FORMAT 

C COL 13-14 LEAVE BLANK IF GNLY 1 RUN--PUT 1 IN COL 14 IF HAVE ADDITIONAL RUNS 
C COL 16-17 NUMBER OF COPIES OF OUTPUT DESIRED 

C COL 19-20 NUMBER OF GROUPS (UP TO 4) 

c 

C NEXT CARD IS FORMAT CARD IF USING FMTM AND FMTC SUBROUTINES 

c 

c DATA CARDS 

c 

C REPEAT BEGINNING WITH YOUR IDENTIFICATION CARD IF ADDITIONAL RUNS 

Cc 


DIMENSION V0309525)5 WI309595)9 X1300595)9V(305595) sSAVI(30) > 
1SAX(30) » SAY (30) 5SVD(595) 9 SWD(595)9SXD( 595) 9 SYD(595) 9SS1(5) 9SS2(5) 
DIMENSION AVE1(30e5) ,AVE2(30,5) 
DIMENSION SAW(30) 
DIMENSION FMT(20),FMTIN(20) 
DIMENSION AWE] (3055), AXE1(3095)5 AYEL(3005)5 SIGI(5),AA(14) 
DIMENSION AWE2 (3055) yAXE2(3095)9 AYE2(3005)5 SIG2(5) 
OIMENSION SIG3(5), SIG4{5) 
OIMENSION IDENT(20) 
10 FORMAT (20F4.0) 
389 FORMAT (6(F6.2,2X)) 
READ (194132) (AA(KKK) »sKKK=1,14) 
9000 READ(124132) (IDENT(M) »M=1220) 
4132 FORMAT (2044) 
C READ PARAMETER CARD 
READ (1512 NNoKKei lb »NFT»NRUN»NCOPY »NGROUP 
1 FORMAT (7(1291X)) 
WRITE (39666) NNyKKelLisNGROUP 
666 FORMAT (* PARAMETER CARD CHECK*/* NUMBER PER GROUP =°,14/*LEVELS 
1 OF TR-1="%,14/" LEVELS OF TR-2="»,14/* NUMBER OF GROUPS =°,14///) 


SOURCE: This program was written by Ronald E. Mihalick and is reproduced here by his permission. 
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c 


aOAnoaOn 


OO OFOE- 


ZERO EVERYTHING 
DO 2 N=leNN 
DO 2 K=1,KK 
OO 2 L=l,it 
VONeKel)=0 
W(N»KyL)=0 
X(NgK,L)=0 
YO(N»K,L)=0 
SAV(N)=0 
SAW(N)=0 
SAX(N)=0 
SAY(N)=0 
SVD(K el )=0 
SWO(KsL)=0 
SXD(KyLI=0 
SYD(KyL)=0 
GS1=0 
GS2=0 
S1G3(K)=0 
S1G4(K)=0 
AVE2(NeK)=0 
SS14K)=0 
$S2(L)=0 
AWE1(NyK2=0 
AXE1(N»KI=0 
AYE1L(NsK)=0 
AWE2(NyL)=0 
AXE2(NeL)=0 
AYG2(N»yLI=0 
AVEL(N»K)=0 
SIG1(K)=0 
S$1G2(K)=0 

2 AVE2(NeL.)=0 
GSUM = 0 
GSA=0 
GSUMSQ=0 
SUMYSQ=0 
SUMY=0 
SUMXSQ=0 
SUMX=0 
SUMWSQ=0 
SUMW=0 
SUMVSQ=0 
SUMV=0 
GSIG1=0 
GS1G62=0 
GSS12=0 
GS123=0 
GAE1=0 
GAE2=0 


TEST TO DETERMINE IF USING FMTC AND FMTM TO CHANGE DATA READ IN FORMATS 


IF (NFT) 1000,1000,2000 
2000 READ (13000) FMT 

CALL FMTC (FMT,FMTIN) 
3000 FORMAT (20A4) 


COMPUTED GO TO SENDS PROGRAM TO PROPER PLACE BASED ON NUMBER OF GRPS. 


GO TO (7,6000,5000,4000) »NGROUP 
1000 GO TO (79695¢%) sNGROUP 
4000 CALL FMTMiFMTIN) 
4 READ (1,10) (CCVONe Kol) »N=Le NN) ¢ K=1L 9 KK) pL=1 LL) 
IF (NFT) 55,5000 
5000 CALL FMTM (FMTIN) 
5 READ (1,910) COCWONs Kel) pN=Le NN)» K=1 9KK) pL=LeLL) 
IF (NFT) 626,6000 
6000 CALL FMIM (FMTIN) 
6 READ (1510) (4(X(NeKei dy N=Ly NN) K=1 9KK) pL=1,LL) 
IF (NFT) 8000,8000,8001 
8001 CALL FMTM (FMTIN) 
8000 READ (1510) (44 Y(Na Kol) eN=1L9NN) 9 K=1L 9 KK) pL=1LyLL) 
GO TO 555 
T ARIFE (3,8) 


8 FORMAT (* ERROR ON PARAMETER CARD» NUMBER OF GROUPS = 1°) 


GO TO 9001 


(NGROUP ) 
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Cc 
Cc 
Cy STERS2 
C STEP 3 
c 


555 GO TO (7913512211) ¢NGROUP 
11 DO 14 N=1,NN 
OO 14 K=1,sKK 
OO 14 L=1,LL 
SUMV=V{NsKyL)+SUMV 
14 SUMVSQ=VINeKel) **2+SUMVSQ 
12 00 15 N=1,NN 
0G 15 K=1,KK 
DO 15 L=lyit 
SUMW=W IN» Kyl )+SUMW 
15 SUMWSQ=WdIN» Kel) €*#2+SUMWSQ 
13 DO 16 N=1,NN 
0O 16 K=1,KK 
OO 16 L=1,LL 
SUMX=X (Ny KyL)4+SUMX 
SUMXSQ=SUMXSQ#XENeKyL) #¥2 
SUMY=Y(NeKsL)+SUMY 
16 SUMYSQ=YINsKyL) **2*#SUMYSQ 


STEP 4 

GET GSUM AND GSUMSQ 
GO TO) (7519518,17),NGROUP 

17 GSUM=GSUM+SUMV+ SUMW+SUMX+SUMY 
GSUMS Q=G SUMS Q¢SUMVSQ+SUMWSQ+SUMXSQ+SUMYSQ 
GO TO 30 

18 GSUM=GSUM+SUMW+SUMX+SUMY 
GSUMS Q=SUMWS Q+SUMXSQ#¢SUMY SQ+GSUMSQ 
GO TO 30 

19 GSUM=GSUM+SUMX+SUMY 
GSUMSQ=G SUMS Q+SUMXSQ#SUMYSQ 


oan 


Cc 
GC PSTERSS 
C GET CGRRECTION TERM 
30 CTERM=GSUM**2/(NN®KK*LL*NGROUP) 
STEP 6 
GET SUM OF SQUARES TOTAL 
SST=GSUMSQ-CTERM 
STEP 7 
GET SUM OF SQUARES GROUPS 
GO TG (792292120) »NGROUP 
20 GV=SUMV*¥*2/ (NN*KK#LL) 
21 GW=SUMW**2/0NN*®KK#LLI 
22 GX=SUMX#*2/(NN*®KK*LL) 
GY=SUMY*##2/(NN#*KK*LL ) 
GO TO (792592423) sNGROUP 
23 GG=GV+GWtGX+GY 
GO FO 26 
24 GG=GWtGX+GY 
GO TO 26 
25 GG=GX+GY 
26 SSGRPS=GG-CTERM 


oo oO 


c 
C STEP 8 
C GET SUM OF SQUARES BETWEEN SUBJECTS 
DO 31 N=1,NN 
DO 31 K=1,KK 
OO 31 L=lytt 
GO TQ (7229928527) »NGROUP 
27 SAVINI=VEINe Kel) SAVIN) 
28 SAW(NI=WINs Kol) +SAW(N) 
29 SAXINI=XINe Kyl) +SAXIN) 
31 SAYIN)J=Y(NsKslLI+SAVIN) 
00 32 N=1lyNN 
GO TO (7535534233) »NGROUP 
33 GSA=SAV(NI*#24+SAW(N) ®©#24+SAX(N9**2¢SAYVIN) **#24+G6SA 
GO TO 32 
34 GSA=SAWIN) **#24SAXK(N) **2+SAV(N)**24+GSA 
GO TO 32 
35 GSA=SAXIN)**24*SAY(N)D *#24+GS4 
32 CONTINUE 
GGSA=GSA/ (KK#LL) 
SSBTSB=GGSA-CTERM 


STEP 9 
BETWEEN SUBJECTS ERROR TERM 
SSEBS=SSBTSB-SSGRPS 


ooo 
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STEP 10 
WITHEN SUBJECTS SS 
SSWS=SST-SSBTSB 
GET SS DOWN FOR EACH GROUP 
0G 40 K=1,KK 
DO 40 L=leLL 
DO 40 N=1,NN 
GO TO (7543542241) »NGROUP 
41 SVD(KyLI=VINe KL I #SVDEKeL) 
42 SWO(KyL)=W(Ne Kel) #SWD( KL) 
43 SXD(KyL)=X(NeKyL) #SXO(KyL) 
SYD(KsLI=Y(NyKyL)+SYD(KyL) 
40 CONT LNUE 
STEP 11 
GET SS FIRST WITHIN S FACTOR 
DO 50 K=1,KK 
DO 50 L=1,LL 
GO TO (7,53,52+51) sNGROUP 
51 SS1{K)=SVD(KeL) #SWOUK 9L) #SXD( KL) #SYD(KyL)+SS1(K) 
GO TO 50 
52 SS1(K)=SWD(K 9h) #SXD(KyL) +SYO(K pL I*SS1IK) 
GO TO 50 
53 SS1(KI=SXD(K Lh) #SYD(KoL) +SS1(K) 
50 CONTINUE 
DO 60 k=1,KK 
60 GS1=SS1(K)*#2/(NN#LL*NGROUP) +6S1 
S1=GS1-CTERM 
C STEP 12 
C GET SS FOR SECOND WITHIN S FACTOR 
DO 70 L=1lyLL 
DQ 70 K=1,Kk 
GO TO (7573-7271) »NGROUP 
71 SS2(L)=SVD(KeL) +SWD(KeL) #SXD(KoL #SYD(KyL 2 +SS2(L) 
GO To 70 
72 SS2(LI=SWD(K oL)+#SXD(KyL) #SYD(K,L)ESS2(L) 
GO TO 70 
73 SS2(L)=SXO(KeL) #SYD(KsL)#SS24L) 
70 CONTINUE 
DO 74 L=1,iL 
74 GS2=SS2(L)##2/ (NN#KK*NGROUP) +GS2 
$2=GS2-CTERM 


o aan 


oOo 


Cc 
C ST€P 13 
C SS INTERACTION GROUPS WITH FIRST FACTOR 
OO 80 K=1sKK 
OO 80 L=lyLt 
GO TO (7379,78,77) »NGROUP 
77 SIGL(KI=SVDO(KyL)+SIGLIK) 
78 SIG2Z(K)J=SWO(KyL)I*#SIG2(K) 
79 SIG3(K)=SXD(KsLIFSIGI(K) 
SIG4(KI=SYD(KyLIFSIG4(K) 
80 “ONTLNUE 
DO 8L K=1lsKK 
GO TO (7,9503,950259501) »NGROUP 
950L GSIGL=SIG4(K)**2/0NN*®LL) +S 1G3(K)**2/ (NN¥LL)+S1G2(K)##2/ (NN#LL) + 
1 SIGL(K) *#2/(NN*LL)+GSIG1 
GO TO 81 
9502 GSIGL=S1G4(K)¥**2/ (NN*¥LL)+S1G3(K)**2/ (NN*LL)+S1G2(K)**2/ (NNFLL) 
1+GSIG1 
GO 10 81 
9503 GSIGL=S1G4(K)#*2/ (NN¥LL) #SIG3(K) **2/(NN*LL) 
1+GSIGL 
GO TO 81 
81 CONTINUE 
SSIGW1L=GSIG1—-CTERM-SSGRPS-S1 
Cc 
C STEP 14 
C SS INTERACTION GROUPS WITH SECOND FACTOR 
DO 9509 K=1sKK 
SIG1(K)=0 
SIG2{K)=0 
S$1G3(K)=0 
9509 SIG4(Kj=0 
DO 90 L=1l,il 
ODO 90 K=1lsKK 
GO TO (7¢89,88,87) yNGROUP 
87 SIGIIL)=SVD{KsL)+SIGL(L) 
88 SIG2Z(L)I=SWO(KyL)+SIG2Z(L) 
89 SIG3(LI=SXD(K,LI+SIG3(L) 
SIG4(LI=SYD(KyL)+SIG4(L) 


c 
Cc 


aan 


oan 


a0 


aon 
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90 CONTINUE 
DO 91 L=lyLL 
GO TO (7,9508,9507,9506) »NGROUP 
9506 GSIG2=SI1G4(L) **2/ (NN¥KK) #SI1G3CL)**®2/ (NN®KK) #S1G2(L) *®*2/(NN®KK) + 
LSIG1(UL)**2/ (NN*KK)+GSIG2 
GO TO 91 
9507 GSIG2=SIG4(L)**2/ (NN*KK) #S1G3(L)**2/ (NN®KK) +S 1G2(L)*®#2/ (NN®KK) + 
LGSIG2 
GO TO 91 
9508 GSIG2=SIG4(L)**2/ (NN®KK) +S1G3(L)**2/ (NN¥KK) 
1+GS1G2 
91 CONTINUE 
SSIGW2=GS1G2-CTERM-SSGRPS-S2 
STEP TIS 
GET INTERACTION BETWEEN FIRST AND SECOND FACTOR 
DO 100 K=1l»KK 
DO 100 L=lyLL 
GO TO (7103,102,101),NGROUP 
101 GSS1L2=(SVD(K el) #SWD(KsL) tSXD( Kol 1+SYD(K el) )**2/(NN®NGROUP) +6SS12 
GO TO 100 
102 GSS12=(SXD(KsL)+SYD(KyL) )*#*2/(NN*NGROUP) #GSS12 
GO TO 100 
103 GSS12=(SXD(KelL)+#SYD(KyL) )*#*2/(NN*¥NGROUP) +GSS12 
400 CONTINUE 
S$S112=GSS12-CTERM-S1-S2 


STEP 16 

INTERACTION GF GROUPS X FIRST FACTOR X SECOND FACTOR 
DO 110 K=1lsKK 
OO 110 L=leil 
GO TO {7,1139112,111),NGROUP 

111 GS123=SVD(KyL) **2/NN#SWD( Kol ) #*#2/NN*+SXD( Ke L)**#2/NN¢SYD( Ky L) ®*#2/NNG 
1GS123 
GO TO 110 

112 GS123=SWDOIKeL) ®*2/NN+SXD(KyL) **#2/NN+SYD( Koh) €*®2/NNtGS123 
GO TO 110 

113 GS123=SXD(K,L)**2/NN#SYD (Kol) **2/NN4+GS123 

110 CONTINUE 
$S1123=GS$123-CTERM—-SSGRPS-S1-S2-SSIGW1-SSIGW2-SSI12 


STEP 17 
TOTAL ERROR TERM WITHIN SUBJECTS 
SEWS=SSWS-S1-S2-SS1GW1-SSIGW2-SS1I12-SS1123 
STEP 18 
GET ERROR TERM FOR Sl AND SIG1--SE1GWL 
00 120 N=1lyNN 
OO 120 K=1+9KK 
DO 120 L=lyLtt 
GO TO (7411641159114) ,NGROUP 
114 AVEL(NsKI=VINeKeLIFAVEL(NeK) 
115 AWEL(N»yKI=WINy Kyl) tAWELINGK) 
116 AXEL(NsKI=X(Ng Kyl) FAXEL(NGK) 
AYEL(NsKI=YINgKyLIFAVELIN SK) 
120 CONT LNUE 
0O 130 N=1yNN 
DO 130 K=1l+sKK 
t=LL 
GO TO (7412991282127) ,NGROUP 
127 GAE1=AVE1(Ny K) ¥#2/L#AWEL (No K) #®2/L+AXEL(N 9K) #*#2/L#AVELIN GK) ##2/L 4 
1GAE1 
GO TO 130 
128 GAE1=AWELINyK) **2/L+AXE1(NoK)*®*2/L4AYVE1L (No K) ¥#2/L4+GAE1L 
GO TO 130 
129 GAE1L=AXE1L(N,K)**¥2/L4AYEL(NeK) **2/L+GAEL 
130 CONTINUE 
SE1GW1=GAE1—CTERM-SSBT SB-S1-SSIGW1 


STEP 19 
GET ERRUR TERM FOR S2 AND SIG2 —--SE2GW2 

DO 140 N=1lyNN 

DO 140 L=lylL 

DO 140 K=1l,KK 

GUO TO (7914651455144) »NGROUP 
144 AVEZ(NyLI=VINe Ky L)FAVE2Z(NgL) 
145 AWE2(NoL)=WINe Kol) FAWE2Z(NoL) 
146 AXE2Z(NyL)=X(No Ky LIFAXEZBNoL< 

AYEZ{NyLI=VINe Kyl) FAVE2Z(NeL) 
140 CONTINUE 

DO 150 N=1l,NN 

DO 150 L=leLil 

K=KK 
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GO TO (791595158,157),NGROUP 
157 GAEZ=AVE2Z(NyL I *®*2/KtAWEZ (Ny Lh )®*2/K+AXE2 (Ny L) ##2/KFAVEZ( Ne L) ##2/K+ 
1GAE2 
GO tG 150 
158 GAEZ=AWE2Z(NoL )**2/KFAXEZ (Noh) **2/K+AYVE2 (No L) ##2/K#GAEZ 
GO TO 150 
159 GAE2Z=AXE2(NyL)**2/K+AYE2 (Nol) #*2/K+GAE2 
150 CONTINUE 
SE2GW2=GAE2-—CTERM-SSBI SB-S2-SSIGW2 


STEP 20 
E12 AND E* b23)——— Et2i23 
£12123=SEWS—-SE1GWI-SE2GW2 
STEP 21 
SET DEGREES OF FREEDOM 
OF TOT=NN*NGROUP*LL*KK-L 
DOF SUB=NN*NGROUP-1 
DFGPS=NGROUP-1 
DFEBT=O0F SUB—DFGPS 
OFWS=DFTOT—DFSUB 
OF 1=KK-1 
DF2=LL—-1 
DFG1=DFGPS*DF1 
DFG2=DFGPS*DF2 
OF 12=DFi*DF2 
OF 123=DFGPS*DF1*DF2 
OFE1=0F1¥*(NN-1) *NGROUP 
OF E2=DF2*(NN-1) *NGROUP 
OF E3=D0F1*DF2* (NN-1)*NGROUP 
CeeSTER 22 
C MEAN SQUARES 
XMSG=SSGRPS/DFGPS 
XMSEB=SSEBS/DFEBT 
XMS1=S1/DF1 
XMSE1=SE1GW1/DFE1 
XMS2=S2/DF2 
XMSE2=SE2GW2/DFE2 
XMSGX1=SSIGW1/DFG1 
XMSGX2=SSIGW2/DFG2 
XMS1X2=SS112/DF12 
XMS123=SS1123/0F123 
XMSE3=E12123/0FE3 


oon 


an 


STEP 23 
DIFFERENCE BETWEEN GROUPS 
F1=XMSG/XMSEB 
C TREATMENT 1 
F25XMS1/XMSE1 
C TR-I 
F3=XMS2/XMSE2 


00 


Cc GxX1l 
F4=XMSGX1/XMSE2 
C Gx2 
F5=XMSGX2/XMSE2 
C 1X2 
F6=XMS1X2/XMSE3 
1X2XK3 
FT=XMS123/XMSE3 


STEP 24 
OUTPUT 
WRLTE (394132) (IDENT(M) »M=1,20) 
9009 WRITE (3,200) 


200 FORMAT (°* TYPE VI ANOV Re MIHALICK 7/10/66*////) 
WRITE (39201) 

201 FORMAT (* SOURCE SS OF MS*s 12X,°F*//) 
KKK=1 


AA(KKK) ALLOWS OUTPUT OF SUMMARY TABLE HEADINGS AS READ IN ON OUTPUT IDENT CD 


oleh aien a) 


WRITE (35202) AA(KKK),SS¥,DFTOT 
KKK=KKK+1 
202 FORMAT (2X9A4¢3X9F132393X9F 50095XeF13-395X9F1204//) 
WRITE (39202) AA(KKK),SSBTS8,OFSUB 
KKK=KKK+1 
WRITE (32202) AA(KKK)»SSGRPS»DFGPS»XMSGoF1L 
KKK=KKK+1 
WRITE (32202) AA(KKK)»SSEBS,DFEBT,XMSEB 
KKK=KKK#1 


c 


9006 
9007 


c 
9005 
9002 
9003 
9004 
9001 


WRITE (3,202) 
KKK=KKK+t1 
WRITE (3,202) 
KKK=KKK+1 
WRITE (3,202) 
KKK=KKK+1 
WRITE (3,202) 
KKK=KKK+1 
WRITE (3,202) 
KKK=KKK+1 
WRITE (39202) 
KKK=KKK+1 
WRITE (3,202) 
KKK=KKK+1 
WRITE (32202) 
KKK=KKK+tl1 
WRITE (3,202) 
KKK=KKK+t1 
WRITE (3202) 
NCOPY=NCOPY-1 


AACKKK) s SSWSsDFWS 

AALKKK) 9 S1,DF1lyXMS1,F2 
AA(KKK) 9 S2,D0F29XMS29F3 
AALKKK) ,SSIGW1 »DFG1»XMSGX1,F4 
AACKKK) 9 SSIGW2¢DFG29XMSGX2,F5 
AA(KKK)», SSI12¢DF129XMS1X2,F6 
AACKKK)» SSI123,D0F1235XMS1239F 
AA( KKK), SE1GW1,OFE1,XMSE1L 
AA(KKK)» SE2GW2sDFE2,XMSE2 


AALKKK)» E12123,0FE35 XMSE3 


IF (NCOPY) 9005,9005,9006 
WRITE (329007) 

FORMAT (///////°* 

GO TO 9009 


DUPLICATE COPY'// 


TEST TO DETERMINE IF HAVE MORE THAN ONE SET OF 


IF (NRUNJ 9001,9001,9002 
WRITE (35,9003) 
FORMAT (/////° 
GO TO 9000 
sToP 
END 

SIZE OF COMMON 00000 


PROGRAM 35358 
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7 


TEST TO DETERMINE THE NUMBER OF PRINTOUTS DESIRED 


4) 


DATA TO RUN 


END OF FIRST RUN--BEGIN SECOND PROBLEM'/////) 
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Appendix M. Program for Latin Square Design: Simple (Section 


2.10) 


ANDAMAN ADANMDAANADARMAAMDAAADAAAANDAANDAAAAAADGDAAADADAAAAAAAAANDAAGAAAAAAAANAA 


PROGRAM LANGUAGE = FORTRAN IV 
PROGRAM WRITTEN FOR IBM 360 OSE LEVEL 


= THE NUMBER OF TREATMENTS; FROM 1 TO NB TREATMENTS. 
= THE NUMBER OF GROUPS; FROM 1 TO NA GROUPS. 
= THE NUMBER OF SUBJECTS PER CELL; FROM 1 TO NSPS S'S EACH. 
HE TOTAL NUMBER OF S'S = NA * NSPS. 
NO. = THE NUMBER OF ORDERS. 
THE "FIRST", "SECOND", & "THIRD" GIVE THE ORDER OF 
PRESENTATION OF THE TREATMENTS. 


THE DATA IS PUNCHED WITH ONE SUBJECT'S DATA PER CARD. 


THIS DESIGN REQUIRES EQUAL N'S. *HE NUMBER OF SUBJECTS PER CELL MUST 


Ry Wy 


00 


1 


R 


W 
F 


BE THE SAME, AND THE NUMBER OF GROUPS MUST BE EQUAL TO THE NUMBER 
OF TREATMENTS.’ SINCE THE NUMBER OF GROUPS = THE NUMBER OF 
TREATMENTS = THE NUMBER OF ORDERS, ALL OF THESE WILL BE REPLACED 
BY THE COMMON VALUE "F" (FREQUENCY). 


VALUES ON THE PARAMETER CARD ARE AS FOLLOWS: 


= THE NUMBER OF THE READ STATEMENT FOR YOUR MACHINE. 
wee NOTE *** 
THIS READ NUMBER MUST ALSO APPEAR IN THE FIRST READ 
STATEMENT IN ORDER TO READ THE PARAMETERS! 
THE NUMBER OF THE WRITE COMMAND ON YOUR MACHINE. 
THE FREQUENCY, AS REFERRED TO ABOVE. 


NS = THE TOTAL NUMBER OF SUBJECTS (INTEGER FORM). 


F 


NS = THE TOTAL NUMBER OF SUBJECTS (REAL FORM - TO AVOID MIXED MODE). 


NSPS = THE NUMBER OF SUBJECTS PER CELL. 


F 


» & NS ARE IN INTEGER FORM, FNS & NSPS ARE IN REAL FORM. 


THE PARAMETER CARD IS TO BE PUNCHED IN THE FOLLOWING ORDER, 


SIX, SPACES» “R", SIX SPACES, “@W"5 SIX SPACES, "Fs SIX 


S 
S 
R 
Cc 


PACES, "NS", SIX SPACES, "FNS", SIX SPACES, "NSPS". 
EE BELOW FOR EXAMPLE. MAKE SURE THE NUMBERS ARE IN THE 
IGHT PLACE; A PRINT OUT CHECK OF THE PARAMETERS IS INCLUDED. 


HECK TO SEE THAT THEY HAVE BEEN READ IN PROPERLY. 
W F NS FNS NSPS 
00 00 000 +000. +000. 
3 3 dy e 2i< 9 Te 


THE PLUS NEED NOT BE PRINTED, IT IS ONLY THERE TO REMIND YOU TO 


L 


EAVE A SPACE FOR IT IN TRE FORMAT. 


PUT PARAMETER CARD ON TOP OF DATA DECKy JUST IN BACK OF /DATA CARD. 


MAKE SURE ALL OF THE DATA CARDS ARE IN THE DECK, IF ONE IS MISSING, 
THE OS-~E LEVEL 360 WILL PRINT AN ERROR MESSAGE, AND NOT RUN DATA. 


CHECK FORMAT 1000 THE NUMBER OF F6.2 PLACES MUST EQUAL THE NUMBER OF GROUPS 


EXAMPLE: 3 GROUP FORMAT:(3X, 3F6.2) 5 GROUP FORMAT:(3X_y 5F6.2) 


DIMENSION SR(10), SC(10), SCL(10,10), SX(50), X(50,50) 
REAL MSGyMSEByMSTRyMSOyMSBOyMSEW, NSPS 
INTEGER Ry Wy F 


ALPHA 


= 05 


C **NOTE** MAKE SURE THE READ NUMBER OF YOUR SYSTEM IS BELOW 


READ 


( 


9001 FORMAT 
C CLEARING ARRAYS TO ZERO 


7 


8 


9 


1, 9001) Ry We Fy NSy FNSy NSPS 
(6X9 12, 6X, 125 6X, 12, 6Xy 1349 6X F500, 6X_y F520) 


DO 7 K=lyF 
SR(K)=0.0 
DO 8 J=1,F 
SC(J)=0.0 
DO 9 I=1,NS 
SX(1)=0.0 
SXX 0.0 
DO 10 K=1lyF 


00 10 J=1y5F 


SOURCE: This program was written by Morris K. Morgret and is reproduced by his permission. 


10 SCL(KyJ)=0.0 
C READING DATA & DATA CHECK 
00 11 [=1,yNS 
11 READ (Ry 1000) (X( Ty), J=1lyF ) 
1000 FORMAT (3X, 5F6.2) 
WRITE (Wy 1111) 
WRITE (We 1001) (XC IJ), J=leF ) 
1001 FORMAT (3X, "THE LAST DATA CARD, CHECK IT!*, 5F6e2) 
C STEP 2 SUMMING CELLS 
C STEP 3 SUMMING ROWS 


DO 2 K=1,F 

DO 2 J=1,F 

Cis= 75 +VENSPS Sea K=—1))) 
L2 = Ll + (NSPS-1) 
DOG2oT= Eby it2 


SR(K)=SR(K) + X(T9J) 
2 SCL(KyJ)=SCL(IKyJ)+ X(T yJ) 
C SUMMING COLUMNS 
DO 3 J=l, F 
00 3 I=ly NS 
3 SC(J)=SC(J) + XC14Jd) 
STEP 4 SUMMING SUBJECTS 
STEP 5 SUM OF SUBJECTS SQUARED 
00 4 I=l, NS 
DO 4 J=ly F 
SX(T)=SX(1) + X(I,J) 
4 SXX = SXX + X(I9J) **2 
STEP 6 OBTAINING GRAND SUM 
CHECK OF GRAND SUM 
G1=0.0 
G=0.0 
DO 20 J=1,F 
20 G=G + SC(J) 
DO 21 K=1l, F 
21 G1l=G1 + SR(K) 
C CHECKING ROW SUMS WITH COLUMN SUMS 
IF (G-G1)30,31,30 
30 WRITE (3% 2001) 
2001 FORMAT (2X, "ERROR, ROW SUM DOES NOT EQUAL COLUMN SUM*) 
31 CONTINUE 
Cc THE TOTAL NUMBER OF MEASURES (FM) = THE NUMBER OF S*S TIMES THE TOTAL 
c NUMBER OF MEASURES PER SUBJECT. 
EMA=UINSPS. SOF, Fe2) 
C STEP 7 OBTAINING CORRECTION TERM (CORR) 
CORR = G ** 2 / FM 
C STEP 8 TOTAL SUM OF SQUARES (SST) 
SST = SXX - CORR 
C STEP 9 SUM OF SSUARES BETWEEN SUBJECTS (SSB) 
SX2 = 0.0 
DO 100 I = ly NS 
100 SX2 = SX2 + SX (I) ** 2 
SSBe= 0SX2e 7a Fem) — ‘CORR 
C STEP 10 GROUPS EFFECT (SSG) 
SR2 = 0.0 
0O 101 K = ly F 
101 SR2 = SR2 + ((SR(K) ** 2 ) / (FNS)) 
SSG = SR2 - CORR 
C STEP 11 BETWEEN S'S ERROR TERM (SSEB) 
SSEB = SSB -— SSG 
C STEP 12 WITHIN S'S SUM OF SQUARES (SSW) 
SOW aso i = SOF 
CeSTEP SIS TREATMENTS: EFFECT (SSR) 
SC2 = 0.0 
DO 102 J = ls F 
102 S€2 = SC2 + (SC(J) ** 2 ) /_CFNS) 
SSTR = SC2 - CORR 
STEP 14 ORDER EFFECTS (SSO) 
SUM CELL TOTALS FOR ORDER OF PRESENTATION IE: SUM CELLS 
RECEIVING TREATMENT FIRST GAGE Tis VPIRST! evel Ce 
FIRST = 0.0 
SECOND = 0.0 
THIRD = 0.0 
FOURTH = 0.0 
FIFTH = 0.0 
IF(F -4) 60,7 61y 62 
Le ORDER EFFECTS FOR A FOUR GROUP DESIGN 
60 FIRST = FIRST + (SCL(1,1) + SCL (2,2) + SCL (3,53)) 
SECOND = SECOND + (SCL (1,2) + SCL (2,3) + SCL (3y1)) 
THIRD = THIRD + (SCL (1,3) + SCL (2,1) + SCL ( 392)) 
ORDER = ((FIRST ** 2) + (SECOND ** 2 ) + (THIRD ** 2)) / (FINS) 


GO TO 63 


ao 


Ci 


aaa 
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C ORDER EFFECTS FOR A FOUR GROUP DESIGN 
61 FIRST = FIRST + (SCL(1,1) + SCL(2,2) + SCL(393) * SCLE(4,4)) 
SECOND = SECOND + (SCL(1,2) + SCL(2,3)+ SCL(354) + SCL(4,1)) 
THIRD = THIRD + (SCL(1,3) + SCL(294) + SCL(391) + SCL(4y2)) 
FOURTH = FOURTH + (SCL(1,4) + SCL(2,91) + SCL(392) + SCL(4y3)) 
ORDER = (FIRST **2 + SECOND*%*2 + THIRD**2 + FOURTH**2 ) / FNS 
GO TO 63 
Cc ORDER EFFECTS FOR FIVE GROUPS DESIGN 
62 FIRST=FIRST + SCL(1,1)+SCL(2,2)+SCL(3,3)4+SCL(494)+SCL (595) 
SECOND=SECOND+ SCL( 1,2) +SCL(243)+SCL(354)+SCL(495)+SCL (5,1) 
THIRD=THIRD + SCL(1,3)+SCL(2,4)+SCL( 3,5) +SCL(491)+SCL(592) 
FOURTH=FOURTH + SCL(1,4)+SCL(2,5)+SCL(3,1)+SCL(4y2)+SCL(53) 
FIFTH=FIFTH + SCL(1,5)+SCL(2,1)+SCL(3,2)+SCL(493)+SCL(554) 
ORDER = FIRST**2 + SECOND**2 + THIRD**2 + FOURTH*®*2 + FIFTH**2/FNS 
63 SSO = ORDER — CORR 
C STEP 15 SUM OF SQUARES B * ORDER INTERACTION (SS80) 
CFLL2 = 0.0 
DO 103 K = ly F 
DO 103 J = ly F 
103 CELL2 = CELL2 + (SCL (KyJ) ** 2) / NSPS 
SSBO) = CELL2Z = CORR — SSG — SSTR = SSU 
C STEP 16 ERROR WITHIN (SSEW) 


SSIEW! = SSW = ( SSTR * SSO + SSBO) 
C STEP 17 COMPUTATION OF DEGREES OF FREEDOM 
DFSST = FM - 1 
DESSB = (NSPS ¥ F | D> =2 
DFSSG =F =1 


DFSSEB = DFSSB - DFSSG 
DFSSW = DFSST - DFSSB 
DESST Resale a 
DESSOs=s at 
DESSBOG= CRs =2 ia hE 1} 
OFSSEW = DFSSW - (DFSSTR + DFSSO + DFSSBO) 
C STEP 18 COMPUTATION OF MEAN SQUARES 
MSG = SSG / DFSSG 
MS EB SS'EB: / DESSEB 
MSTR SSTR / DFSSTR 
MSO = SSO / DFSSO 
MSBO SSBO / DFSSBO 
MS EW SSEW / DFSSEW 
C STEP 19 COMPUTATION OF F RATIOS AND PROBABILITIES 
FGPS = MSG / MSEB 
FTR = MSTR / MSEW 
FO = MSO / MSE&W 
FBOI = MSBO / MSEW 
Cc CALLING SUBROUTINE "PLEVEL" TO COMPUTE PROBABILITIES 
CALL PLEVEL ( DFSSGy DFSSEBy, FGPS, PGPS) 
CAUL PLEVEL (DFSSTRy DFSSEWy, FIR», PTR) 
CALL PLEVEL (DFSSO, OFSSEW, FO, PO) 
CALL PLEVEL (DFSSBO, DFSSEW, FBUOI, PBOI) 


wo 


AOV PRINT OUT PART OF PROGRAM 
WRITE OUTS OF ROW AND COLUMN SUMS, SUMS OF SCORES», SUM OF SCORES 
SQUARED, AND GRAND SUM 
WRITE (Wy 1111) 
1111 FORMAT ('1") 
DO 37 K=ly F 
37 WRITE (Wy 3001) SR(K) 
3001 FORMAT(2X_, "SUM OF ROW(K)=', F10.2) 
WRITE (Wy 2222) 
2222 FORMAT ('0', //) 
DO 38 J=ly, F 
38 WRITE(W, 3002) SC(J) 
3002 FORMAT (2X, *SUM OF COLUMNS (J)=', F10.2) 
WRITE (Wy 2232) 
2232 FORMAT ('O'y ///) 
DO 39 I=ly NS 
39 WRITE (Wy 4001) SX(T) 
4001 FORMAT(2X, "SUM OF X=" F10.2) 
WRITE (Wy 2242) 
2242 FORMAT (*°O0", ///7/) 
DO 40 K=l, F 
DO 40 J=ly F 
40 WRITE(Wy 5001) SCLI(KyJ) 
5001 FORMAT (2k, "THE SUM OF CELLS(KyJ) =" , 9F8.2) 
WRITE (Wy 6001) SXxX 
6001 FORMAT (20X, "SUM OF SCORES SQUARED=', F12.2,/) 
WRITE (Wy 6002) G 
6002 FORMAT (20X, "THE GRAND SUM=', F12.2,//) 
WRITE(Wy 7002) SST 
7002 FORMAT(20Xy "THE TOTAL SUM OF SQUARES ='y, F12.2,//) 


aaa 
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WRITE (Wy 7001) CORR 
7001 FORMAT (20X,y "THE CORRECTIUN TERM="', F1l2.2,//) 
WRETE We 5553))) CELILZ 
5553 FORMAT (20X, '"CELL2=", F102, /) 
WRITE (Wy 5552) SC2 
5552 FORMAT (20Xy 'SC2=", F8.2_ /) 
WRITE (Wy 5551) SX2 
5551 FORMAT (20X, "SX2=", F8.2) 
WRITE (Wy 7777) Ry Wy Fe NSy FNSy NSPS 
7777 FORMAT (20X, "R=",I2, SXy "WH", 129 5X_ "FH", 129 5X "NS=", 13, 
1 SX-_ "FNS="5 F5e25 5X- "NSPS=", F522) 
WRITE (Wy 1111) 
WRITE (Wy 1011) 
1011 FORMAT (3X, "SOURCE", 20Xy "SS", 9X, "DF', 6Xy "MS*y LOX, Fly 
L LOXs) YO*) 
WRITE (Wy 1012) 
1012 FORMAT ('0') 
WRITE (Wy 1013) SST, DFSST 
1013 FORMAT (3X_ "TOTAL", 19X¢y F7e2s 5Xy FOe2s/ ) 
WRITE (Wy 1014) SSBy DFSSB 
1014 FORMAT (5X, "BETWEEN', 15X_y FTle2y 5Xy F6e2 9/ ) 
WRITE (Wy 1015) SSGy DFSSG, MSGy FGPS, PGPS 
1015 FORMAT (7Xy "GROUPS*', 14Xy Fle2y 5X F6e2y 3Xo FOe2y 4X_y FOe2y 
1 4X5 F5e39/ ) 
WRITE (Wy 1016) SSEBy DFSSEBy, MSEB 
1016 FORMAT (7X, "ERROR'y 15Xy Fle2y 5Xy F6e2s 3Xy F6e2y/ ) 
WRITE (Wy 1012) 
WRITE (Wy 1017) SSW, DOFSSW 
1017 FORMAT (3X, "WITHIN', 18X_ FTle2y 5Xy FOe2s/ ) 
WRITE (Wy 1018) SSTRy DFSSTRy MSTRy FTIR, PIR 
1018 FORMAT (7X, "TREATMENT', 11X_ FTle2y SX_y FOe2y 3Xy FOe2y 4Xy FOe2y 
1 4X5 F5e39/ ) 
WRITE(Ws 1019) SSO, DFSSOs MSO, FO, PO 
1019 FORMAT (7Xy "ORDER", 15Xy Fle2y 5Xy F6e2y 3Xy FOe2y 4Xy F5Se2s 
1} 4X5 F503: of) 
WRITE (Wy 1020) SSBO, DFSSBO, MSBO, FBOI, PBOI 
1020 FORMAT (7Xy *B X ORDER", 11Xy FTe2y SX F6e2e 3X FOe2y 4Xo FSe2y 
UE SX ailk Stade 9 /m) 
WRITE (Wy 1021) SSEW, DFSSEW, MSEW 
1021 FORMAT (7X, "ERROR", 15Xy Fle2s 5X5 F6e2y 3X9 FOe2e S///) 
CALL FSTAT (DFSSG, DFSSEB, ALPHA, FGP) 
WRITE (Wy 6661) FGP 
6661 FORMAT (30X,'THE F REQUIRFI) FOR SIG. GROUPS EFFECT=", F8.2,/) 
CALL FSTAT (DFSSTR,y DFSSEW, ALPHA, FT) 
WRITE (Wy 6662) FT 
6662 FORMAT (30Xy"THE F REQUIRED FOR SIG. TRIALS EFFECT="'y F8.2,/) 
CALL FSTAT( DFSSO, DFSSEW, ALPHA, FOR) 
WRITE (Wy 6663) FOR 
6663 FORMAT (30X, 'THE F REQUIRED FOR SIG. ORDER EFFECT=', F862y /) 
CALL FSTAT (OFSSBO, DFSSEW, ALPHA, FBO) 
WRITE (Wy 6664) FBO 
6664 FORMAT (30X,'THE — REQUIRED FOR SIG. B BY ORDER INTERACTION=", 
1 F8.2, S//) 
STOP 
END 
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Analysis of variance 


designs for, 16-105 
completely randomized, 17, 22-25 
discussion of, 16-21 
factorial 
three factors, 17-18, 30-37 
two factors, 17, 25-30 
Latin square 
complex, 21, 92-105 
simple, 20-21, 84-91 
computer program for, 262 
mixed 
three factors (repeated measures 
on one factor), 19-20, 61-72 
three factors (repeated measures 
on two factors), 20, 72-83 
computer program for, 255 
two factors (repeated measures on 
one factor), 19, 54-61 
repeated-measures, 18, 43-47 
treatments-by-levels, 18, 38-43 
treatments-by-subjects, 18, 43-47 
treatments-by-treatments-by-sub- 
jects, 18-19, 47-54 
supplemental computations for, 106- 
149 
differences among several independ- 
ent variances, 106, 110-111 
differences between variances of two 
independent samples, 106, 107— 
108 
differences between variances of two 
related samples, 106, 109-110 
discussion of, 106-107 
Duncan’s multiple-range test for 
nearly equal ns, 107, 115-117 
F-maximum test for homogeneity of 
variances, 106, 110-111 
F-tests for simple effects, 107, 117- 
123 
homogeneity of independent vari- 
ances, 106, 107-108 
homogeneity of related variances, 
106, 109-110 
orthogonal components in tests for 
trend, 107, 123-149 
t-test for differences among several 
means, 107, 112-114 
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Blocking and tabling of data, 2-4 


Chi-square 
complex, 196, 209-213 
simple, 196, 207-209 
table of centile values for, 220-221 
Computer programs 
for simple Latin square design, 262 
for three-factor mixed design (repeated 
measures on two factors), 255 
Contingency coefficient (C), 196, 209-213 
Correlation, 150-194 
correlation ratio (eta), 151, 166-168 
covariance, see Covariance, analysis of 
discussion of, 150-152 
Fisher’s z transformation of r, 191 
table of, 226-227 
Kendall rank-order correlation coeffi- 
cient (tau), 151, 159-163, 170-171 
multiple correlation (three variables), 
151, 171-173 
partial correlation (three variables), 
151, 168-169 
using Kendall’s tau, 170-171 
Pearson product-moment correlation 
coefficient (7), 150, 152-155 
table of critical values of, 228-229 
point-biserial correlation, 151, 163-166 
rank-order correlation 
Kendall coefficient (tau), 151, 159- 


163 

partial, using Kendall’s tau, 151, 
170-171 

Spearman coefficient (rho), 151, 
156-159 


reliability of measurement tests 
test as individual items (Kuder- 
Richardson and Hoyt), 151, 
188-191 
test as a whole (test-retest, parallel 
forms, split halves), 151, 187-188 
significance tests of 
between dependent correlations, 152, 
193-194 
between independent correlations, 
152, 191-192 
See also the end of each section pre- 
senting a particular correlation. 
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Covariance, analysis of 
complex, 151, 177-186 
simple, 151, 173-177 


Data 
blocking and tabling of, 2-4 
organization of, discussion, 1—2 
Duncan’s multiple-range test for nearly 
equal ns, 107, 115-117 
table of significant ranges for, 236-241 


F-distribution table, 222—225 
F-maximum test for homogeneity of 
variances, 106, 110-111 
table of critical values for, 234-235 
F-tests for simple effects, 107, 117-123 
Factorial analysis of covariance, 151, 
177-186 
Factorial designs for analysis of variance 
two factors, 17, 25-30 
three factors, 17-18, 30-37 
Fisher’s z transformation of r, 191 
table of, 226-227 


Hoyt’s test for reliability of measure- 
ment, 151, 188-191 


Kendall rank-order correlation coefficient 
(taw), 151, 159-163 
in partial correlation, 151, 170-171 
Kuder-Richardson test for reliability of 
measurement, 151, 188-191 


Latin square design for analysis of vari- 
ance 
complex, 21, 92-105 
simple, 20-21, 84-91 
computer program for, 262 
Levels design for analysis of variance, 18, 
38-43 


Mann-Whitney U-test, 196, 201-204 
table of critical U values, 230-233 
Mean, standard error of the, 6-7 
Multiple correlation (three variables), 
151, 171-173 


Nonparametric tests 
chi-square 
complex, and the contingency coeffi- 
cient (C), 196, 209-213 
simple, and the phi coefficient, 196, 
207-209 
for differences between independent 
samples (Mann-Whitney U-test), 
196, 201-204 
for differences between related samples 
(Wilcoxon sign test), 196, 205-206 


for significance of difference between 
two proportions, 195-196, 199-201 
for significance of a proportion, 195- 
196, 197-198 
Normal-curve areas, table of, 216-217 


Organizing data 
blocking and tabling, 2-4 
range and standard deviation, 4-6 
standard error of the mean, 6 
Orthogonal tests for trend, 107, 123-149 
table of orthogonal coefficients, 243 


Parallel-forms reliability measure, 151, 
187-188 
Partial correlation 
using Kendall’s tau, 151, 170-171 
with three variables, 151, 168-169 
Pearson product-moment correlation co- 
efficient (r), 150, 152-155 
Fisher’s z transformation of r, 191 
table of, 226-227 
table of critical values of, 228-229 
Phi coefficient, 196, 207-209 
Point-biserial correlation, 151, 163-166 
Proportions 
significance of differences between two, 
195-196, 199-201 
significance of one, 195-196, 197-198 


Range, 4-6 
Rank-order correlations 
Kendall’s coefficient (faw), 151, 159- 
163 
partial 
using Kendall’s tau, 151, 170-171 
with three variables, 151, 168-169 
Spearman’s coefficient (rho), 151, 156- 
159 
Reliability-of-measurement tests 
test as individual items (Kuder-Rich- 
ardson and Hoyt), 151, 188-191 
test as a whole (test-retest, parallel 
forms, split halves), 151, 187-188 


Sign test (Wilcoxon), 196, 205-206 
table of critical values of, 242 

Significance tests, see each section cover- 
ing a particular topic 

Spearman rank-order correlation (rho), 
151, 156-159 

Split-halves reliability measure, 151, 187- 
188 

Squares and square roots, table of, 244— 
253 

Standard deviation, 4-6 

Standard error of the mean, 6 

Student’s ¢, see t-tests 


t table (critical values), 218-219 
t-tests 
for differences between sample mean 
and population mean, 7-9 
for differences among several means, 
107, 112-114 
for differences between two independ- 
ent means, 9-12 
for differences between two related 
measures, 12-15 
Tabling and blocking of data, 1-4 
Test for difference between variances of 
two independent samples, 106, 107— 
108 
Test for difference between variances of 
two related samples, 106, 109-110 
Test for differences among several inde- 
pendent variances, 106, 110-111 
Test for significance of difference be- 
tween two proportions, 195-196, 
199-201 
Test for significance of a proportion, 195- 
196, 197-198 
Test-retest reliability measure, 151, 187- 
188 


269 


Tests for trend, 107, 123-149 

Treatments-by-levels design for analysis 
of variance, 18, 38-43 

Treatments-by-subjects design for analy- 
sis of variance, 18, 43-47 

Treatments-by-treatments-by-subjects 
design for analysis of variance, 18- 
19, 47-54 


U-test of Mann-Whitney, 196, 201-204 
table of critical values of, 230-233 


Variance, analysis of, see Analysis of 
variance 


Wilcoxon sign test, 196, 205-206 
table of critical values of, 242 


z (standard deviates), table of, 216-217 
z transformation (Fisher’s) of 7, 191 
table of, 226-227 
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,, Frank W. Carlborg, Northern Illinois University. 
soncepts underlying many of the most widely used statistical methods. 


ductory probability theory, testing hypotheses, and estimating 
ing on multiple regression and the analysis of variance, the book is 
‘ader identify a statistical problem in his work and interpret a statistical 


n. 
ages. 


